Unit C2 
Vector spaces 


Introduction 


In this unit you will meet a mathematical structure that is one of the most 
important unifying concepts of pure mathematics. It is that of a vector 
space. A vector space consists of a set of elements called vectors, and two 
operations: addition of vectors and multiplication by a scalar. These 
vectors need not be vectors in the geometric sense given in Book A; 
instead, they may be a wide range of objects including complex numbers, 
functions and matrices. 


You will first consider properties of R? and R, and see how these two- and 
three-dimensional spaces lead not only to n-dimensional space R”, but also 
to the formal definition of a vector space. You will meet a variety of quite 

different vector spaces and study various concepts relating to vector spaces. 
For example, you will meet the idea of a subspace of a vector space, which 
is a subset of a vector space that is itself a vector space; this is similar to 

the relationship between subgroups and groups, which you met in Book B. 


The theory of vector spaces introduced in this unit will underpin the 
remaining units of this book. 


1 Vector spaces 


In Book A you met the plane and three-dimensional space. In this section 
you will see that properties that you are familiar with in these two- and 
three-dimensional spaces also hold for other, quite different-looking spaces. 


1.1 Euclidean spaces 


Recall from Unit Al Sets, functions and vectors that R? is the set of all 
ordered pairs of real numbers, and R? is the set of all ordered triples of real 
numbers. You saw that we can interpret these sets as the plane and as 
three-dimensional space, respectively, in the following two ways. We can 
interpret their elements first as the coordinates of points with respect to a 
specified coordinate system, and second as vectors in component form with 
respect to this coordinate system. 


In this way, once axes have been specified, we can consider the elements 
of R? equivalently as ordered pairs, as points in the plane, or as vectors in 
the plane. And likewise for R?, we can consider the elements equivalently 
as ordered triples of real numbers, as points in three-dimensional space or 
as vectors in three-dimensional space. 


Also in Unit Al, you met two operations: addition of vectors and 
multiplication of a vector by a scalar. These operations are defined on R? 
and IR? as follows. 
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Definitions 


In R?, the set of ordered pairs of real numbers, the operations of 
addition and of multiplication by a scalar are defined as: 


(u1, U2) + (v1, v2) = (u1 + v1, U2 + V2), 
a(u1, u2) = (au1,au2), where o € R. 


In R?, the set of ordered triples of real numbers, the operations of 
addition and of multiplication by a scalar are defined as: 


(u1, u2, u3) + (v1, v2, v3) = (u1 + v1, U2 + v2, U3 + v3), 


a(u1, u2, u3) = (au), Quz, quz), where o € R. 


It turns out that R? and R? are particular instances of a class of 
mathematical structures called vector spaces. In this unit you will meet 
many other examples, and study the properties that are common to all of 
them. 


You are familiar with vectors in R? and R, but there is no reason to stop 
at R? — why not consider R4, IR?, or even R”, for larger positive integers n? 


Definitions 


Let n be a positive integer. An ordered n-tuple is a sequence of real 
numbers (u1,2,...,ug). The set of all ordered n-tuples is called 
n-dimensional space, and is denoted by R”. 


To highlight the connection between n-dimensional space (for a positive 
integer n), denoted by R”, and 2- and 3-dimensional space with 
geometrical vectors, the space IR" is often called a Euclidean space and 
its elements (u1, u2,...,Un) are called vectors. For example, Rt is the 
four-dimensional Euclidean space of vectors with four components. 


Although it is difficult to visualise vectors in spaces with dimension greater 
than three, it is possible to carry out exactly the same algebraic 
manipulations with these vectors, and it turns out that these spaces are 
also vector spaces. 


Vector addition and scalar multiplication in R” are defined as in IR? 
and R. 


Definitions 
Let 
U= (up usc 3 Un) EM Y Dp uo ep) 


be two vectors in IR". The operations of addition and of 
multiplication by a scalar are defined as: 


Wy = (ur Upeaa Un) (01, paaa Un) 
= (uy + v1, U2 + 2,..., Un + Un), 
au = (au1,QU2,...,AUn), where a ER. 


Worked Exercise C20 


Let u = (1,1,...,1) and v = (1,2,...,n) be two vectors in R”. Form the 
vectors u + v and 2u. 


Solution 
Wav = (lee i Ue Oe gc 
Duc Hi ly easg l) = (2,22022) 


Exercise C44 


Let u = (1, —1, 2,0, —3) and v = (0,2, —1, 4,0) be two vectors in R5. Form 
the vectors u + v and —3u. 


This method of generalisation (here from IR? and R? to R”) is common 
throughout mathematics. We start with spaces like IR? and R? that we can 
visualise and look at their properties, and then we generalise these 
properties to spaces that we cannot easily visualise, such as IR". So we go 
from particular cases to a general case. 


We can go even further, and think of a vector with a never-ending list of 
components (v1, t5, U3,...). This is hard to visualise, but is not difficult to 
handle mathematically. The set of such vectors is called R, and is an 
infinite-dimensional vector space. (You will meet a formal definition of 
dimension of a vector space in Section 3.) Vector addition and scalar 
multiplication are again performed component-wise. 
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Worked Exercise C21 


Let u = (1,0,1,0,1,...) and v = (1, —2, 3, —4,5,...) be two vectors in R™. 
Form the vectors u + v and 5u. 


1.2 Real vector spaces 


Before meeting the definition of a vector space, we will look at Rt and a 
set of polynomials, and will observe that, despite their apparent 
differences, these sets share many important properties. 


The space R* 


A vector in IR^ has the form (v1, v2, v3, v4), where v1, v2, v3 and v4 are real 
numbers, and the operations of vector addition and scalar multiplication 
are as defined in the previous subsection. 
If we have two vectors u = (uj, u2, u3, u4) and v = (v1, v2, v3, v4) in R4, 
then their sum is 

u + v = (u1, U2, U3, u4) + (v1, V2, v3, U4) 

= (uj + v1, U2 + V2, U3 + U3, U4 + v4). 

This last vector also belongs to IR^ because each of the four components is 
a real number, so R* is closed under vector addition; that is, the closure 
property (A1), which you met in Unit A2 Number systems, holds for the 
addition of vectors in R4. 


For example, if u = (1,3,5,7) and v = (2, — 1, —5,6) are vectors in IR^, then 
otv=(,55,7) 2041-30020), 
which is a vector in R4. 


In fact addition of vectors in R^ satisfies all the usual rules of arithmetic, 
as follows. The next worked exercise proves the commutative property 
(A5) and the additive identity property (A3), and you are asked to prove 
the remaining two properties in the following exercise. 


Addition of vectors in R4 

A1 Closure For all u,v € Rf, 
Tey eRe 

A2 Associativity For all u,v, w € R^, 
(u+v)+w=u+(v+w). 

A3 Additive identity For all v € R^, and 0 c R4, 
V 3E) m y m V. 


AA Additive inverses For each v € R^, there is a vector —v € R* 
such that 


v+(-v) =0=-vdv. 
A5 Commutativity For all u,v € R4, 


USAN = Wear Uh 


Worked Exercise C22 


Prove that the following properties hold for vector addition in R£. 


(a) The commutative property (A5): u + v = v + u. 


(b) The additive identity property (A3): v + 0 = v = 0 + v, where 0 is 
the zero vector (0,0, 0, 0). 
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Exercise C45 


Prove that the following properties hold for vector addition in IR^. 
(a) The associative property (A2): (u + v) - w 2u- (v +w). 


(b) The additive inverses property (A4): v + (Cv) = 0 = —v + v, where 
v= (v1, V2, V3, V4) and —v = ( U1, —U2, —U3, v4). 


Recall from Unit B1 Symmetry that a set with a binary operation is a 
group if the following four axioms hold: 


G1 (closure); G2 (associativity); G3 (identity) and G4 (inverses). 


The first four properties (A1—A4) of vector addition in R^ show that the 
set R^ under the operation of vector addition satisfies these four 
properties; that is, (Rt, +) is a group with additive identity the zero vector 
(0,0,0,0), and —v the additive inverse of v. The final property, 
commutativity (A5), shows that it is in fact an abelian group. 


These properties all involve vector addition, but IR^ also has some 


properties that involve scalar multiplication. 
Let v = (v1, v2, 03, v4) € R^ and a € R. Then 
av = a(v4, V2, U3, V4) = (o, ov, avs, ova). 
This vector also belongs to R^, so R^ is closed under scalar multiplication. 
For example, if v = (1,2, —5, —3) € R* and a = 4, then 
av = 4(1,2, —5, —3) = (4,8, —20, —12), 
which belongs to R£. 


Note that if you multiply a vector in R* by 8 € R, and then by a € R, you 
obtain the same result as multiplying by of. This is because, for all 
a, B € R and v = (v1, v», v3, v4) E RÉ, 
o(Bv) = o(B(vi, v», va, v4)) 
= a(Bwvi, Bv», Bus, Bva) 
= (a8v1, aBv2, o Bua, aBv4) 
= (a8) (v1, va, v3, v4) 
= (a)v. 
For example, if v = (1,2, —5, —3) € R* and a = 4, 8 = —2, then 
a(Bv) = 4(—2(1, 2, —5, —3)) 
= 4(—2, —4, 10,6) 
= (—8, —16, 40, 24) 
= (—8)(1, 2, —5, —3) 
= (aB)v. 


Also, if v = (v1, v2, v3, v4), then 


lv = 1(v1, V2, V3, V4) = (v1, V2, U3, V4) = V. 


These properties of scalar multiplication of vectors in R4 can be 
summarised as follows. 


Scalar multiplication of vectors in R4 
S1 Closure For all v € R^, and o € R, 


av € R*. 


S2 Associativity For all v € R^, and o, f € R, 


a(Bv) = (af)v. 
S3 Scalar multiplicative identity For all v € IR, 


hy = wy, 


Finally, there are two distributive properties that connect vector addition 
and scalar multiplication. 
For example, if u = (1,3,5,7) and v = (2, —1, —5,6) are vectors in R^, and 
a = 3 and 6 = 4, then 
a(u+v) = 3((1,3,5, 7) + (2, 21, —5,6)) 
= 3(3, 2,0; 13) 
= (9,6, 0,39) 
and 
au + av = 3(1,3,5, 7) + 3(2, —1, —5, 6) 
= (3,9, 15, 21) + (6, —3, —15, 18) 
= (9, 6,0, 39), 
which illustrates the first distributive property. Also, 
(a+ B)v = (3 + 4)(2, —1, —5, 6) 
= 7(2,—1, —5, 6) 
= (14, —7, —35, 42) 
and 
av + Bv = 3(2, —1, —5,6) + 4(2, 21, —5,6) 
= (6, —3, —15,18) + (8, —4, —20, 24) 
= (14, —7, —35, 42), 


which illustrates the second. 
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'These properties connecting vector addition and scalar multiplication can 
be summarised as follows. 


Combining addition and scalar multiplication of vectors in IR* 
D1 Distributivity For all u,v € R^, and a € R, 


a(u+v) = au + av. 


D2 Distributivity For all v € R^, and o, 8 € R, 
(a+ B)v = av + Bv. 


The space of quadratic polynomials 
Let us now look at another, apparently very different set of elements. This 
is the set of quadratic polynomials, namely, functions of the form 
p:R—R 
r a 4- bx + ca, 


where a,b,c € IR. We call this set P3 because it comprises all the real 
polynomials of degree less than 3. Thus 


P; = (p(z) : p(x) =a+ bz + cx”, a,b, c € R}. 


Here we have used the convention from Book A that when a real function 
is specified only by a rule, it is understood that the domain of the function 
is the set of all real numbers for which the rule is applicable, and the 
codomain of the function is IR. 


(We write the terms of the polynomial in increasing order of powers here, 
as usually done when working within a vector space of polynomials.) 


To simplify the notation further, we write 
Ps = {a+ bz + ca? : a,b, c € R}. 


This set includes the quadratic polynomials (where c is non-zero), the 
linear polynomials (where c is 0 and b is non-zero) and constants (where b 
and c are 0 and a is non-zero), as well as the zero polynomial (where 

a — b — c= 0). At first sight, there is no reason why this set of elements 
should have the properties that we have just shown are satisfied by R4; 
however, these properties all hold for this set as well. 


First we consider the properties A1—A5 involving addition. 
Consider pi(x) = a1 + bya + cya? and po(x) = ag + box + co, then 
pi(z) + po(x) = (a1 + byz + cx?) + (ag + bow + coz?) 
= (a1 + a2) + (bs + b2)z + (&1 + eo)z?, 


which also belongs to P3. Therefore the closure property (A1) holds for 
addition in P3. 
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For example, 3 + 4x — 2z? and 5 — 3x + 7x” both belong to P5, and 
(3 + 4z — 22?) + (5 — 3x + 727) = 8 + x 4-527, 


which also belongs to P3. The next worked exercise proves the 
commutative property (A5) and the additive inverses property (A4), and 
you are asked to prove the remaining two properties in the following 
exercise. 


Worked Exercise C23 


Prove that the following properties hold for addition in P4. 


(a) The commutative property (A5): pi(x) + pa(x) = po(x) + pı (£). 
(b) The additive inverses property (A4): 
pi(x) + (—pi(x)) = 0 = -pı (z) + pı (z). 


Exercise C46 


Prove that the following properties hold for addition in P3. 

(a) The associative property (A2): 
(pi(x) + pa(x)) + p3(x) = pi(x) + (p2(x) + ps(z)). 

(b) The additive identity property (A3): pı(x) +0 = pi(x) = 0 + pı (x), 
where 0 = 0 + 0x + 0x? is the zero polynomial in P3. 
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It follows that P3 satisfies the same addition properties as Rt, and 
therefore P5 is also an abelian group under addition. 


We can multiply a polynomial through by a real constant; that is, by a 
scalar. In fact P3 has the same properties involving scalar multiplication as 
IR^. 


Let p(x) = a + bx + cz? and a € R, then 

op(z) = a(a + br + cz?) = (aa) + (ab)z + (ac)z?, 
which also belongs to P3. So P3 is closed under scalar multiplication; that 
is, the closure property (S1) holds for P3 under scalar multiplication. 


In the following exercise you are asked to check the remaining properties 
involving scalar multiplication (S2 and 83), for a particular case. 


Exercise C47 


Let p(x) = 1 — z + 22? and a= 2, 6 = —3. Show that the following 
properties hold for these scalars and this quadratic polynomial. 


(a) The identity property (83): 1 x p(x) = p(x). 
(b) The associative property (82): a(8p(z)) = (aB)p(x). 


'To finish looking at the properties of P5, we note that the distributive 
properties (D1 and D2) that connect addition and scalar multiplication 
hold for P5; the proofs simply involve multiplying out brackets. For all 
pi(x),pa(x) € Ps and o, 8 ER, 


o(pi(z) + po(x)) = api (x) + ape(x) 


and 


(a+ B)pi(z) = apı (x) + Bpi(z). 


So Rf and P; satisfy the same set of properties with respect to addition 
and scalar multiplication, even though R* is a Euclidean space and P; is a 
set of polynomials. The idea that connects them is the concept of a vector 
space. 


Vector space definition 


In Book B we studied symmetries of geometric figures, and then abstracted 
the properties to obtain the definition of a group. We go through a similar 
process here. We have just studied R* and P3, and we now abstract from 
them the definition of a vector space. We then go on to look at other 
examples of vector spaces. The elements of these vector spaces are of 
diverse types: complex numbers, functions, matrices, and many others. 


The definition of a vector space is one of the longest definitions in 
mathematics. It looks formidable, but the axioms A1-A5, 81-83 and 
D1-D?2 are precisely the properties we checked for R^ and P3. Thus this 


definition follows naturally from our previous examples. As for R^ and P3, 
axioms A1—A5 refer to vector addition (implying that a vector space is an 
abelian group under addition), S1-S3 refer to scalar multiplication, and 
D1-D2 to how we combine these operations. Therefore a vector space is a 
set of objects called vectors that can be added together and scalar 
multiplied in such a way that all the usual properties of arithmetic hold. 
'Thus the definition includes the properties for addition, the properties for 
scalar multiplication and the properties of how these two operations 
combine. 


Definition 
A real vector space consists of a set V of elements called vectors 


and two operations, vector addition and scalar multiplication, such 
that the following axioms hold. 


Axioms for addition 
A1 Closure For all v1, vo € V, 
vi t v € V. 
A2 Associativity For all v1, vo, v3 € V, 
(v1 + v3) + va = vı + (v2 + v3). 


A3 Additive identity For all v € V, there is a zero element 
0 € V satisfying 


v+0=v=0+v. 


A4 Additive inverses For each v € V, there is an element —v 
(its additive inverse) such that 


v+(-v) =0=-v+v. 
A5 Commutativity For all vi, v2 € V, 
Wit ar YW = Waele 
Axioms A1-A5 imply that (V, +) is an abelian group. 
Axioms for scalar multiplication 


S1 Closure Forall ve V, anda € R, 
ave V. 

S2 Associativity For all v € V, and o, 8 € R, 
a(Bv) — (aB)v. 

S3 Scalar multiplicative identity For all v € V, 


hy e 
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Axioms combining addition and scalar multiplication 


D1 Distributivity For all vj, vo c V, anda € R, 
a(vi + v3) = avı + ava. 

D2 Distributivity For all v € V, and o, 8 € R, 
(a+ B)v = av + Bv. 


The word ‘real’ in this definition refers to the fact that the scalars used in 
forming scalar multiples are real numbers; that is, a real vector space is a 
vector space over the field R (which means that the scalars are elements in 
IR). More generally, it is possible to define a vector space over any field, so 
it is also possible to form complex and rational vector spaces, where the 
vectors are scalar multiplied by complex and rational numbers, 
respectively. This is because the sets of complex and rational numbers are 
also fields. However, we are only concerned with real vector spaces in this 
module. 

It is worth noting that R itself is a real vector space: the fact that the 
vector space axioms hold for V = R follows from the field properties that 
hold for IR, which were shown in Unit A2 when considering the arithmetic 
of real numbers. 

Where we use the term vector for the elements of vector spaces, many 
mathematical texts use the terms element and vector interchangeably. 


Checking the axioms 


We now look at the set V = {a cos x + bsinz : a,b € R} of functions, and 
show that it is a real vector space by checking all the axioms in the 
definition. You will not be asked to check all these axioms in a single 
exercise: this example simply illustrates how it can be done. 


Addition and scalar multiplication are defined on V as follows. 


If a; cos x + bı sin x and as cos x + bz sin x are vectors of V, and a € R, then 
(a1 cos x + bı sin x) + (az cosa + bə sin x) 
= (a, + a2) cos x + (bi + b2) sin z 
and 


a(a; cos z + bı sin x) = aa; cos x + ab; sin z. 
For example, 

(3 cos z + 2sin x) + (4cos g — 6sinz) = 7cosz — 4sin x 
and 

—b5(3 cos z + 4sin x) = —15cosz — 20sin z. 


We check the axioms one by one. 


A1 Closure V is closed under addition of functions, since, if 
à4 COS x + bı sin x and a2 cosg + bo sin x are vectors of V, then 


(a1 cos x + bı sin x) + (ag cos x + bz sin x) 
= (a4 + a3) cos x + (bı + b2) sing, 
which is a vector of V. 
A2 Associativity Addition is associative, since, if a, cos z + bı sin x, 
a2 COS x + bə sin z and a3 cos x + bg sin x are vectors of V, then 
((a cos x + bı sin x) + (az cos x + bg sin x )) + (ag cos x + bs sin x) 
= ((a4 + a2) cos x + (bı + b2) sin x) + (a3 cos x + bg sin x) 
= (a4 + a2 + a3) cos z + (bi + b2 + b3) sin x 
and 
(a1cos x + by sin z) + ((ag cos x + bo sin x) + (a3 cos x + bg sin x)) 
= (a4 cos z + bı sin x) + ((a2 + a3) cos x + (b + b3) sin x) 
= (a4 + a2 + a3) cos z + (bi + b2 + bg) sin x. 


A3 Additive identity The zero vector is 0 cos z + Osin z, since this is 
in V and, if acosz + bsinz € V, then 


(a cos z + bsinz) + (0cosz + Osin x) = acosz + bsinz 
and 
(0 cos z + Osin x) + (acosz + bsinz) = acosz + bsin z. 


A4 Additive inverses The additive inverse of a cos z + bsin z is 
—acosx — bsinz, since this is in V and, if acosz + bsinz € V, then 


(a cos x + bsinz) + (Cacosz — bsinz) = 0cosz + Osin x 


and 


(—a cosg — bsin x) + (a cosx + bsin x) = 0cosz + Osin zx. 
A5 Commutativity Addition is commutative, since, if a4 cos x + b sin z 
and a» cos x + bə sin x are vectors of V, then 
(a1 cos x + bı sina) + (az cos x + bə sin x) 
= (a1 + ag) cos z + (bı + b2) sin z 
and 


(a2 cos x + bg sin x) + (a1 cos x + bı sin x) 


= (aa + a1) cos x + (bo + b) sinx 


= (a4 + a3) cos x + (bı + b2) sin x. 


S1 Closure V is closed under scalar multiplication, since, for 
a cos x + bsinz € V and o € R, we have 


a(a cos x + bsin x) = aa cos x + absin z. 


This is in V, since oa, ab € R. 
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$2 Associativity For o, 8 € R and acosz + bsinz € V, we have 


a (B(a cos zx + bsinx)) = a(Bacosz + Bbsin x) 


apa cos z + absin x 
= (a8)(a cos x + bsin x). 
$3 Scalar multiplicative identity For acosz + bsin x € V, we have 
l(acosz + bsin x) = acosz + bsin z. 
D1 Distributivity For a € R and a4 cos x + bı sin z and 
ag COS z + bə sin x in V, we have 
a((a3 cos x + b sin x) + (az cos x + bə sin x)) 
= a ((a1 + a2) cos z + (by + 02) sin x) 
= a(a1 + a3) cos z + a(bı + 05) sin z 
and 
a(a cos z + bı sin x) + a(ao cos x + bz sin x) 
= aa, cos x + ab, sin z + ea» cos z + abo sin x 


= a(a1 + a3) cos z + a(bı + be) sin x. 


D2 Distributivity For o, f € R and acosz + bsinz € V, we have 
(a+ B)(a cos xz + bsin zx) 
= (a + B)acosz + (a + B)bsinz 
= aa cos z + absin z + ba cosg + Dbsin x 
and 
a(a cos x + bsin z) + B(a cosa + bsin x) 


= aa cos x + ob sin x + Ba cos x + Dbsin x. 


Since all the vector space properties are satisfied, V is a vector space. 


We now look briefly at some further examples of vector spaces, to give you 
some idea of the different areas of mathematics in which this concept arises. 


The set of linear polynomials P, 


'The set P» of linear polynomials comprises the real polynomials of degree 
less than 2; that is, the polynomials of the form p(x) = a + bx, where 

a,b € R. Vector addition and scalar multiplication are defined on P5 as 
follows. 


If p(x) = a+ bx and q(x) = c + dz, and a € R, then 

p(x) + g(a) = (a+ bz) + (c + dz) = (a + c) + (b + d)z 
and 

ap(x) = a(a+ bx) = (aa) + (ab)z. 


The result of each of these operations is a linear polynomial, so P» is closed 
under the operations of addition and scalar multiplication, and therefore 
satisfies the closure axioms (A1 and S1). The other axioms can be checked 
in the same way. 


More generally, for each positive integer n, the set P, of real polynomials 
of degree less than n, with the usual operations of addition and scalar 
multiplication, is a vector space. 


The set of complex numbers C 


The set C comprises the numbers of the form a + bi, where i? = —1 and 
a,b € IR. Vector addition and scalar multiplication are defined on C as 
(a+ bi) + (c+ di) = (a 4- c) 4- (b 4- d)i 
and 
a(a + bi) = (aa) + (ab)i. 
This is a real vector space because we multiply the complex number (the 
vector) by a real number (the scalar). 


The result of each of these operations is a complex number, so C is closed 
under the operations of vector addition and scalar multiplication, and 
therefore satisfies the closure axioms (Al and $1). The other axioms can 
be checked in the same way. 


The set M23 of 2x3 matrices with real entries 


The set M»,3 comprises the 2 x 3 matrices of the form 


a b c 
E c p? where a,b,c,d,e, f € R. 


Vector addition and scalar multiplication are defined on M» 3 as follows. 


If A = a1 02 43 and B = bi ba ba , and a € R, then 
Q4 G5 G6 b4 bs bo 


A + B= ay ag Q3 + bi bo b3 
Q4 5 a6 b4 bs bg 
_ » +b, a2+b2 ag+ 


a4+b4 a5+b5 ag + be 
and 


ak =a P ag 2 = i Qa» P , 
G4 a5 G6 aa, ads adag 
The result of each of these operations is a 2 x 3 matrix with real entries, so 
this set is closed under the operations of vector addition and scalar 


multiplication, and therefore satisfies the closure axioms (Al and $1). The 
other axioms can be checked in the same way. 


More generally, for positive integers m and n, the set Mmn of m x n 
matrices with real entries is a vector space under the operations of vector 
addition and scalar multiplication. 


1 Vector spaces 
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The set IR^? 

If u = (u1, u5,...) and v = (v1, vs, ...) belong to R”, and a € R, then 
u + v = (u1,u5,...) + (v1, v2,...) = (u1 + v1, U2 + vo, ...) 

and 
au = our, dig..««) = (aui, tg; 2 a), 


The result of each of these operations is a vector of R, so IR^? is closed 
under the operations of vector addition and scalar multiplication, and 
therefore satisfies the closure axioms (A1 and S1). The other axioms can 
be checked in the same way. 


These examples are only a few of the many real vector spaces. You will 
meet more of them as you work through this unit, and as you encounter 
other mathematical concepts in the remainder of this module. 


We finish this section by looking at some sets that are not vector spaces. 
In each case you should assume the usual definitions of addition and scalar 
multiplication for the elements of these sets to show that these sets are not 
vector spaces. 


Worked Exercise C24 


Show that neither of the following sets is a real vector space. 


(a) V = {all polynomials of degree equal to 5} 
(b V={a+bieC:a>0} 


2 Linear combinations and spanning sets 


Exercise C48 


Show that neither of the following sets is a real vector space. 
(a) V={(z,y) E€ R?: y=2r4+1} 


(b) v=4(5 c) sab cez} 


2 Linear combinations and spanning 
sets 


In this section you will see that in a vector space, some sets of vectors are 
special. These special sets are such that every other vector in the space 
can be produced by adding combinations and scalar multiples of vectors 
just in this special set. 


2.1 Linear combinations 


We begin by looking at the different ways in which we can express a single 
vector in R? as a combination of two other vectors. 


For example, the vector (5,3) in R?, illustrated in Figure 1, can be written 
as 


(5,3) = 5(1,0) -F 3(0, 1). 


(1,0) 


Figure 1 The vector (5,3) as 
a linear combination of (1,0) 


and (0, 1) 
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(2,0) 


Figure 2 The vector (5,3) as 
a linear combination of (2, 0) 
and (1, 1) 


(—1, —4,4) 


Figure 3 A vector in R? asa 
linear combination of three 
vectors 


(LU) 


Figure 4 A vector in R? asa 
linear combination of three 
vectors 
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We could also write (5,3) in terms of (2,0) and (1, 1), illustrated in 
Figure 2. In this case we have 


(5,3) = 1(2,0) + 3(1, 1). 


If you look at the right-hand sides of these equations, you will see that 
they both have the same form. In each case we have written 


(5,3) = avı + Bv», 


where v; = (1,0), vo = (0,1), a=5 and 6 = 3 in the first case, and 
vi = (2,0), v2 = (1,1), a = 1 and 8 = 3 in the second case. 
We call avı + £v» a linear combination of the two vectors vı and v». 


Because vı and v» are vectors in R?, so are avı and 8v2, since they are 
scalar multiples of vı and v2; and hence so is ov, + v2, since it is the 
sum of two vectors in R2. So av; + Bv» is also a vector in R2. 


Similarly in R?, the vector (—1, —4, 4), illustrated in Figure 3, can be 
written as 


(—1, —4,4) = —1(1,0,0) — 4(0, 1,0) + 4(0,0, 1) 


or as illustrated in Figure 4, in terms of the three vectors (1,0, 2), 
(0, —1,3) and (1,1,1) as 


(—1,—4,4) = 2(1,0,2) 4-1(0, 1,3) — 301,151), 


These are two examples: they are not the only possibilities. Each of these 
equations has the form 


(=1; —4, 4) = avi + Bv» + yva, 


where the expression on the right-hand side of the equation is a linear 
combination of three vectors. 


These linear combinations of vectors in IR? and IR? are particular examples 
of the following definition. 


Definition 
Let vi, v5,..., Vy belong to a vector space V. Then a linear 
combination of the vectors v1, v2,..., Vy is a vector of the form 


Q1V1 + Q2V2 +--- + (&Vk, 


where @1,Q@2,...,@ are real numbers. This vector also belongs to V. 


We begin by looking at how we can form linear combinations of vectors, 
and then investigate whether we can write a particular vector as a linear 
combination of other vectors in the same vector space. 


In the worked exercises and exercises of this section we have tried to keep 
the arithmetic simple by using integer scalar multiples and coordinates. In 
general, any real numbers may occur. 


2 Linear combinations and spanning sets 


Worked Exercise C25 


(a) In R?, calculate the linear combination 2v, + 3v2 when vı = (1,0,3) 
and v2 = (0,2, —1). 

(b) In R4, calculate the linear combination 2v1 + 3v2 + 4v3 — v4 when 
Vi = (i; 0, 3, 1); V2 = (0, 2, 0, —1), V3 = (0, I; —2, 0) and 
vas (2,10, —2,—1). 


Exercise C49 


(a) In R?, let vı = (0,3) and vo = (2,1). Calculate the linear 
combination 4v, — 2v». 


(b) In R4, let vı = (1,2, 1,3) and v2 = (2,1,0, —1). Calculate the linear 
combination 3v + 2v. 


We now look at linear combinations of vectors in vector spaces other than 
R?, R? and R^. In the worked exercise and exercise that follow, we assume 
that the operations of vector addition and scalar multiplication for 
polynomials, matrices and functions are the usual ones. 


Worked Exercise C26 


For each of the following vector spaces V and vectors v1, vo and v3 in V, 
form the linear combination 3v, — 2v» + v3. 


(a V=Ps, vi—-l-c-z-ctz, vo—1-z, vy=r+r. 


i 0 2 2 —1 0 
(b) V = M23, “i= (4 = J v= (i 3 2 


aaf 9 0 
a AG Day" 
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Exercise C50 


For each of the following vector spaces V and vectors vı and v» in V, form 
the linear combination 2v, — 4v». 


(a) V= P, vy =2-—2+3827, va — —14 a. 


(b) V is the set of all real functions, v; —sinz, vo = rcosz. 


—1 1 3 1 
(c) V = M29, vi=( 2 v= (i E 


Now that we have formed linear combinations of different numbers of 
vectors in various vector spaces, we consider the harder problem of 
deciding whether we can express a given vector as a linear combination of 
a particular set of vectors. In the next worked exercise, we look at an 
example before giving a general strategy. 


Worked Exercise C27 


Determine whether (3, — 1) can be expressed as a linear combination of 
each of the following. 


(a) vı = (2,0) and v2 = (1,1). (b) vı = (2,2) and və = (1, 1). 
(c) vi = (9, —3) and v» = (—6,2). 


2 Linear combinations and spanning sets 


Solution 


(a) 


We need to find real numbers o and ( such that 
(3, -1) = a(2,0) + B(1, 1), 

that is, 
(3,-1) = (2a + B, B). 


€ We equate the two first coordinates (components) to get 
3 = 2a + B, and then the two second coordinates (components) 
to get -1= B. @ 


Equating corresponding coordinates, we obtain the system of 
linear equations 


AGL ae (oi 
B=-1. 
Substituting 6 = —1 in the first equation gives a = 2. So 
(3, =) T 2(2,0) " i(i, 1) 
= 2v1 = Vo: 
We need to find real numbers o and ( such that 
(3, =1) = a(2, 2) ar B, TE 
that is, 
(3, —1) = (2a + 8,2o + B). 
Equating corresponding coordinates, we obtain the system 
Dag 
20 ge E ==], 


€, The left-hand sides of these equations are the same but the 
right-hand sides are different, so we can immediately conclude 
that they are inconsistent. Alternatively, subtracting the second 
equation from the first yields the equation 0 = 4. . £9 


This pair of equations is inconsistent, since no values of a and 8 
satisfy both of them. 


€. We might have expected this since any linear combination of 
(1,1) and (2,2) must have both coordinates the same. .® 


We cannot express (3, —1) as a linear combination of these two 
vectors. 


We need to find real numbers a and ( such that 
(3, —1) = a(9, —3) + 8(—6, 2), 

that is, 
(3, —1) = (9a — 68, —3a + 28). 
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The following strategy describes the method we have just used. 


Strategy C6 


To determine whether a given vector v can be written as a linear 
combination of the vectors vi, V2,..., Vk: 


1. write v = o4v4 + Q2V2 t ::: + GV 

2. use this expression to write down a system of linear equations in 
the unknowns a1,Q2,...,Q 

3. solve the resulting system of equations, if possible. 


Then v can be written as a linear combination of v1, v5,..., vi if and 
only if the system has a solution. 


Recall from Unit C1 Linear equations and matrices that a system of linear 
equations may have no solution, a unique solution, or infinitely many 
solutions. Therefore this strategy may give no solution, a unique solution, 
or infinitely many solutions, as we saw in Worked Exercise C27. 
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When dealing with polynomial functions, such as those in P5, we use the 
fact that two polynomial equations in the variable x are equal if and only 
if the coefficients of corresponding powers of x are equal, and equate 
corresponding coefficients. 


Worked Exercise C28 


(a) 
(b) 


In R3, express the vector (1,1, 1) as a linear combination of the 
vectors (1,0, 1), (0, 1,2) and (—1,1,0). 


In P5, express the polynomial 2 + 2x + 52? as a linear combination of 
the polynomials 1 + 3z? and 2x — z?. 


Solution 
We follow the steps of Strategy C6. 


(a) Let o, B and y be real numbers such that 


UE E 1) = a(1, 0, 1) x B(0, 12) xs desde 10) 
Then 
Gye 4b E T 2) 


Equating corresponding coordinates, we obtain the system 


q — m 
Bpod 
a 4- 28 =l 


Adding the first two equations gives a + B = 2, and solving this 
and the last equation gives 9 — —1 and « — 3. Substitution then 
gives y = 2, so the required linear combination is 


(Ph = 30,1) O 2) 21 1,0), 


(You may have used Gauss-Jordan elimination to solve the 
system of linear equations, rather than solving them directly. 
Either method is fine.) 
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Exercise C51 


(a) 


(b) 


(c) 


In R?, express the vector (2,4) as a linear combination of the vectors 
(0,3) and (2,1). 

In R3, express the vector (2,3, —2) as a linear combination of the 
vectors (0, 1,0), (1,2, —1) and (1,1, —2). 


. 1 : TM 
In M22, express the matrix [o " as a linear combination of the 


. 1 -1 0 -2 
matrices G j and (à D 


2.2 Spanning sets 


We now look at the set of vectors that is produced when we form all 
possible linear combinations of a given set of vectors. 


Picture any two vectors in R?, and suppose that we form all possible linear 
combinations of these two vectors. What vectors do we obtain? Are there 
any vectors in R? that cannot be written as a linear combination of these 
two vectors? (We saw such an example in Worked Exercise C27(b).) What 
happens if we start with one vector in R?? If we form all possible linear 
combinations of it, what vectors can result? What happens if we start with 
one, two or three vectors in R°? 


2 Linear combinations and spanning sets 


Let us start with a set consisting of exactly one vector in R? — namely, the 
set containing the vector (1,0). The set of all linear combinations of (1, 0), 
illustrated in Figure 5, is 


{a(1,0):a € R} = {(a,0): a € R}. 


Geometrically, the members of this set are the points on the z-axis in R?. 
So this set of linear combinations is a line (the z-axis) in R?. We say that 
the set {(1,0)} spans the x-axis, and that the z-axis is spanned by {(1,0)}. 


Suppose that we now take the set ((1,0), (0,1)} containing two vectors. 
The set of all linear combinations of (1,0) and (0,1), illustrated in 
Figure 6, is 

{a(1,0) + B(0,1): o,8 € R} = {(a, 8) : a, B € R}. 
Since a and f can take any real values, this set consists of all the points in 
IR?. We say that {(1,0),(0,1)} spans R?, and that IR? is spanned by 
{(1,0), (0, 1). 


We now write down the formal definitions of span and spanning, before 
looking at some more examples. 


Definitions 


Let S = (v1, V2,..., Vk} be a finite set of vectors in a vector space V. 

Then the span (S) of S is the set of all possible linear combinations 
01Vi t A2QV2 +++: + O&Vk, 

where 04,02,...,0, are real numbers; that is, 

(S) = (o1v1 + a2 vo +--+ + og vg :01,02,..., Qk € R}. 


We say that the set of vectors (v1, vo,..., vy) spans (S) or is a 
spanning set for ($), and that (S) is the set spanned by S. 


While S is a finite set of vectors, the span (S) is generally an infinite set of 


vectors (such as a line or plane): this is because the linear combinations 
involve the set of real numbers. In fact, the span (S) is itself a vector 
space, as you will see later, in Subsection 4.1 (Theorem C28). 


'To test whether a vector v lies in the span of a given set S, we use 
Strategy C6 to determine whether v can be written as a linear 
combination of the vectors in S. 


(1,0) 


(a, 0) 


Figure 5 The linear 
combinations of (1,0) 


(1,0) 


Figure 6 The linear 
combinations of (1,0) and 
(0, 1) 
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Worked Exercise C29 


Let S = ((1,1,0), (0, 1, 1)). Which of the following vectors belong to (S)? 
(a) (0,0,1) — (b) (4,2, —2) 


Solution 


We apply Strategy C6. 


(a) 


We write 
CUR E DTE 0) C ro 9 PRU a 
Equating corresponding coordinates, we obtain the system 


a =) 


®. Subtracting the first and third equations from the second 
yields the equation 0 = —1. .$ 


This system is inconsistent and therefore has no solution. So 
(0,0, 1) does not belong to (S). 


We write 
(4,2, —2) = a(1, 1,0) + 8(0, 1, 1) = (o, a + B, B). 


Equating corresponding coordinates, we obtain the system 


The first and third equations give a = 4 and 6 = —2, and these 
values also satisfy the second equation. So (4, 2, —2) belongs to 
(S) and it can be written as 


(4,9. 9) = (01.1.0) = 210) 1,3): 


Exercise C52 


Let vı = (1,0,3), v2 = (0,2,0) and v3 = (0,3, 1) be three vectors in R3. 
Use Strategy C6 to determine whether the vector (1,5,4) lies in the subset 
of R? spanned by each of the following sets. 


(a) (vo va) — (b) ivo v2; v3} 


Strategy C6 can also be used to show that a given set of vectors is a 
spanning set for the whole of a particular vector space, as we show in the 
following worked exercise. 
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Worked Exercise C30 


Show that each of the following is a spanning set for R?. 


(a) {(1, 2), (2, 23H (b) {(1,0), (1, D. (1, 239] 


Solution 


€. We need to show that every vector in R? can be expressed as a 
linear combination of the given vectors, so we show that the general 
vector (x,y) can be. .$ 


(a) 


Each vector in R? can be written as (x,y). To show that (x,y) is 
in ({(1, 2), (2, 23))), we write 

(x,y) = a(1, 2) + B(2, —3) = (a + 28, 2a — 38). 
Equating corresponding coordinates, we obtain the system 

a+26=2 

20 — 3B zb 
whose solutions are a = (3a +2y), B= 4 (2a — y). So any vector 
in R? can be written in terms of (1,2) and (2, —3) as 

(x,y) = $(3z + 2y)(1, 2) + $(2z — y)(2, -3). 
Thus {(1, 2), (2, —3)) is a spanning set for R?; that is, 


(4, 2), (2; -3)p = R?. 


Each vector in R? can be written as (x,y). To show that (x,y) is 
in EL 0), (i, 1); Ge =D) we write 

(x,y) = a(1,0) + 8(1,1) + Y(1, -2) 
Equating corresponding coordinates, we obtain the system 

Os oe — 

poco. 

93, We saw in Unit C1 that a consistent system of m equations in 
n unknowns, with m < n, has an infinite solution set. 9 


This is a system of two linear equations in three unknowns, so if 
there is a solution, there will be infinitely many solutions. 


€. We need just one solution, so try to simplify things by setting 
y-0. e% 


For example, taking y = 0 gives 6 = y and a = x — y. So 
(x,y) = (z s y)(1, 0) ae y(1, 1) s 0(1, 22s 
Thus 4, 0), (í, 1); (i =) = R?. 
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The solution to Worked Exercise C30(b) shows that the set ((1,0), (1, 1)) 
is a spanning set for IR? so, in some sense, the vector (1, —2) is redundant. 
We return to this idea of redundant vectors in a spanning set in the next 

section. 


Exercise C53 


Show that each of the following is a spanning set for R?. 


(a) {(1, 1), (=1,2)} (b) {(2, —1), (3, 2)} 


Exercise C54 


Show that {(1,0,0), (1, 1,0), (2,0, 1)} is a spanning set for R3. 


The following worked exercise shows that Strategy C6 can be used for 
vector spaces other than R? and R. 


Worked Exercise C31 


Show that {1+ z?, 22,2 — x} is a spanning set for P3. 


2 Linear combinations and spanning sets 


Exercise C55 


Show that {1+ z, 1 + z2,1 -- a?, x) is a spanning set for Py. 


We look now at sets S in vector spaces V for which (S) is not the whole 
of V. 


Worked Exercise C32 


For each of the following vector spaces V and sets of vectors S in V, 
determine (S). In parts (a) and (b), describe (S) geometrically. 


(a) VSR, S41). 
(b) V=R?, S = {(1,0,1), (2,0,3)}. 


© vex S-l( o o)-(o o o) lo o0) 


Solution 
(a) We have 
(S) = (o(1,1): a E R} = {(a,a):a € R}. 
@. A picture can help. f 


YA 


(1,1) 


Geometrically, (S) is the line y = zx. 
(b) We have 
(S) = {a(1, 0,1) + 8(2,0,3):a,6 € R} 
= {(a+ 28,0,a+ 38): o, 8 € R}. 
€. Every point in this set is of the form (z,0,z). &@ 
Thus 


(S) c Ai(e0,2) cr ee NI. 


®. To determine whether (S) is equal to this set we have to show 
that every vector (x,0,z) can be expressed as a linear 
combination of (1,0, 1) and (2,0,3). #@ 
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To show that every vector (2,0, z), where z, z € R, belongs to 
(S), we write 


(2,0,2) = (a+ 28,0, a + 38). 
Equating corresponding coordinates, we obtain the system 


a+28=2 
a+ 3B =z. 


The solution is 8 = z — x and a = 3x — 2z, so 
(2,072) = (3x = 2z)(1, 0, 1) a (z z x)(2,0,3). 


Hence (2,0, z) € (S), so any vector of the form (x, 0, z) can be 
written in terms of (1,0, 1) and (2,0,3). It follows that 


(Sy sr. 0-s 2 2e Ry. 
€&. A picture can help. & 


Sy 


Geometrically, (S) is the plane y = 0. 


We have 
=1 0 i @ & 
0 j d (( 0 ;) 


»-(4 


Re 1 x d saby ER} 


b 
€. Every matrix in this set is of the form i, 0 i e 


Thus 


2 Linear combinations and spanning sets 


€». To determine whether (S) is equal to this set we have to show 
that every matrix of this form can be expressed as a linear 
combination of the three given matrices. © 


'To show that every 2 x 3 matrix with zero entries in the second 
row belongs to (S), we write 


a o eA (F 2 pL 
© 0 0 0 0 0 : 


Equating corresponding entries, we obtain the system 


2a+ B = 
—a ey 
38 + 2y=c 


It has solution 
dc 4(3a — b — c), 
p= F(a +2b+ 2c), 
y = —di(3a + 6b — c), 
so 


W 
ee 
Il 
qa 
LESS 
STS 
Dne 
Se 


) ia beeR]. 


Exercise C56 


For each of the following vector spaces V and sets of vectors S in V, 
determine (S). 


(a) V —R?, S= {(1,0,0)}. 


o rens {G DCG 9} 
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3 Bases and dimension 


In this section you will see that there is a minimum number of vectors 
needed to span a vector space. 


3.1 Linear independence and dependence 


In Section 2 we found several spanning sets for R? and RÌ. For example, in 
Worked Exercise C30(b), we showed that each of the sets 


{(1,0),(1,1)} and {(1,0), (1,1), (1, -2)} 


spans R?. In order to be able to work efficiently with a vector space, we 
need to express each vector in it as a linear combination of a small number 
of vectors. In particular, it would be convenient if we could find a set 
containing the smallest number of vectors that spans the space — that is, 
we want to find a minimal spanning set. 


The set ((1,0), (1, 1), (1, —2)} is clearly not a minimal spanning set for R?, 
since the smaller set ((1,0), (1, 1)? also spans R?. The vector (1, —2) is 
redundant because it can be written as a linear combination of the vectors 
(1,0) and (1, 1): 
(1,—2) = 3(1,0) — 2(1, 1). 
Thus, if a vector (x,y) in R? can be written as a linear combination of the 
vectors (1,0), (1, 1) and (1, —2), then it can be written as a linear 
combination of just the vectors (1,0) and (1, 1): 
(T, y) = a(1, 0) t B(1, 1) T (1, —2) 
= o(1, 0) + Bd, 1) EE yB, 0) m 2(1, 1)] 
— (o T 3y)(1. 0) + (8 = 27) (1, 1). 
The following general result holds. 


Theorem C20 


Suppose that the vector vj, can be written as a linear combination of 
the vectors vi, V5,..., Vk—1. Then the span of the set {vi,vo,..., vx) 
is the same as the span of the set (v1, vo,..., vj i1. 


Proof Let S = ((vi, vo,..., vk-1]) and T = ({vi, va,..., vx). 
Clearly, S C T. 


Now 

T = {aivi + o2va t: + QkVk :01,02,..., 0 € IR). 
As v, can be written as a linear combination of v1, vo,... , Vy. 4, it follows 
that 


Vk = B1v1 + Bove +++ + By 1vk-a, for some 81, 5,..., By 1 € R. 


So any vector of T' can be expressed in the form 
O1V| + A2QV2 + +++ c OkVK 
= o1Vi + o2V2 t::: + Ok-1Vk-1 
+ ag(G1vi + Bove +--+ + Bk-1Vk-1) 
= (o1 + aK 81) v1 + (a2 + aK B2)v2 + +++ + (oa + Akpk-1)Vk-1, 
which belongs to S. Thus T' C S. 


Combining these two results gives S = T, as required. ig 


So, in order to tell whether a spanning set is minimal, we need to be able 
to test whether every vector in the set can be written as a linear 
combination of the remaining vectors in the set. To make this task easier, 
we introduce the ideas of linear dependence and linear independence. 


Definitions 


A finite set of vectors (vi, V2,...,Vx} in a vector space V is linearly 
dependent if there exist real numbers @1,Q2,...,a%, not all zero, 
such that 


Qivic Vo + :-- + QkVk = 0. 


A finite set of vectors (vi, V2, ..., Vk} is linearly independent if it 
is not linearly dependent; that is, if 


04V1 + @2V2 T ::: + ovy = 0 


only when o; = ag —--:-— oj, — 0. 


Note that ay = ag —-::: = aj = 0 is a solution to the equation whether 
the set of vectors is linearly dependent or linearly independent. So the 
distinction between the two cases is whether there is a non-zero solution. 


We use the term linearly dependent because if a set of vectors is linearly 
dependent, then one of the vectors can be written as a linear combination 
of the others — that is, this vector depends on the others. If 


o1Vi T Q2V2 +-+: d ovy = 0, 
and a, (for example) is non-zero, then we can rearrange the equation to 
give 
Q1 Qk—1 


Ve = V1 ie Vk-1; 
Ok Ok 


so that v; is a linear combination of the remaining vectors. Hence 
[vi, V2,..., Vk} is a linearly dependent set. 


For example, if 2v4 + 3v2 — 4v3 = 0, then v3 = ivi + iva. In this case, 
{vi, V2, v3} is a linearly dependent set. We can also write vı in terms of 
v9 and va, and similarly v2 in terms of vı and v3. 


3 Bases and dimension 
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Conversely, if one of a set of vectors can be written as a linear combination 
of the others, then the set is linearly dependent; that is, if vz is a linear 
combination of the vectors v1, v5,..., Vy 1, then (vi, vo,..., Vk} is a 
linearly dependent set. 


Statements 1 to 4 below follow from the definitions. 


1. If (v1, v2,..., vi] is a linearly independent set, then there is only one 
way in which the zero vector can be expressed as a linear combination 
of v1, V2,..., Vy; that is, the trivial way 


0 = 0v4 + Ove +--+ + Ove. 
2. If vı is the zero vector, then for a € R, 
av; + 0vg+---+0v;, = 0, 


so any set of vectors containing the zero vector is linearly dependent. It 
follows that a linearly independent set cannot contain the zero vector. 


3. Any set consisting of just one non-zero vector v is linearly independent 
because if av = 0, then either a = 0 or v = O. Since v is non-zero, we 
must have o = 0, so the set (v) is linearly independent. 


4. Any set of two non-zero vectors is linearly dependent if one of the 
vectors is a multiple of the other, and linearly independent otherwise. 
This applies to vectors in all vector spaces: it is not restricted to vectors 
in R? and R?. 

As an example of statement 4, consider the set {(1, 1,2), (2,2, 4)) in R?. 

We have 


(2, 2,4) m 2(1, 1, 2), 
SO 
—2(1,1,2) + (2,2, 4) = (0,0,0), 


which is the zero vector in R3. In this case a; = —2 and as = 1. So this 
set is linearly dependent. 


Similarly, (3 — 2x + z?, 6 — Az + 2x7} is a linearly dependent set in Pj 
because 


6 — 4r + 2x? = 2(3 — 2x + x”), 
so 
2(3 — 2a + 22) — (6 — 4a + 227) = 0 + 0x + 027, 
which is the zero vector in P3. In this case ay = 2 and ag = —1. 


However, neither {(1, 1,2), (1,2, —3)} nor (3 — 2z + 32, -1-- z + 22?) isa 
linearly dependent set, as in each case neither vector is a multiple of the 
other. 


Statement 4 therefore gives us a particularly simple way of checking 
whether a set of two non-zero vectors is linearly dependent or linearly 
independent: namely, a set of two non-zero vectors is linearly independent 
if and only if neither vector is a multiple of the other. For vectors in IR? 
and R?, this is equivalent to saying that two non-zero vectors are linearly 
independent if and only if they do not lie along the same straight line — 
that is, they are not collinear, as illustrated in Figure 7. 


y YA 


Ry 
Xy 


(a) (b) 


Figure 7 Two vectors in R? that are (a) linearly independent (b) linearly 
dependent 


In this geometric interpretation of R? a vector (x,y) is the position vector 
(x,y), not the point with coordinates (x, y). Therefore ‘being collinear’ is a 
property of the vectors (position vectors), not the points with these 
coordinates. For example, the two points (1,0) and (1, 1) are collinear 
since they lie on the line z — 1, whereas the vectors (1,0) and (1,1) are 
not collinear since they are not multiples of one another and they do not 
both lie on a line through the origin: they are linearly independent vectors. 
By their definition as position vectors, collinear vectors will always lie on a 
line through the origin. 


Similarly, three non-zero vectors in IR? are linearly independent if and only 
if they do not lie in the same plane — that is, they are not coplanar, as 
illustrated in Figure 8. In this geometric interpretation of R? *being 
coplanar’ is again a property of the vectors (position vectors) not the 
points, so coplanar vectors in IR? will always lie on a plane through the 
origin. 


Qy 


T W T 
(a) (b) 


Figure 8 Three vectors in R? that are (a) linearly independent (b) linearly 
dependent 
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More generally, we can use the following strategy to test whether a set of 
vectors is linearly independent. 


Strategy C7 


To test whether a given set of vectors (vi, v2,..., vi] is linearly 
independent: 


1. write down the equation o4v4 + Q@gv2o + -+ QkVk = 0 


2. express this equation as a system of linear equations in the 
unknowns 04,02,...,Ofk 


3. solve the resulting system of equations. 


If the only solution is ay = ag = :-- = ag = 0, then the set of vectors 
is linearly independent. 


If there is a solution with at least one of a1,Q2,...,a,% not equal to 
zero, then the set of vectors is linearly dependent. 


Worked Exercise C33 


Use Strategy C7 to determine whether each of the following sets of vectors 
in R? is linearly independent. 


(a) ((2,0,0),(0,0,1),(-1,2, D) (b) {(1,1,1), (0,2,1), (1,5,3)} 


Solution 
We follow the steps of Strategy CT. 
(a) We write a(2,0,0) + 8(0,0, 1) + y(—1, 2,1) = (0,0,0). 


€. This simplifies to (2a — y, 27,8 + y) = (0,0,0). Equating 
corresponding coordinates gives the equations we need. © 


This gives the system of linear equations 


2a = sped 
Zy = 
B+ y=0. 


The second equation gives y = 0. Substituting this value into the 
other two equations gives a = 0 and 6 = 0. The only solution is 


Therefore this set of vectors is linearly independent. 
(b) We write a(1,1,1) + 6(0,2,1) + y(1, 5,3) = (0,0, 0). 
This gives the system of linear equations 
a + g= 
a 28 +5y=0 
a B 4- 3y — 0. 
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®. A solution is not so easy to see, so we use the method of 
Gauss-Jordan elimination from Unit C1. £9 


We perform row-reduction on the augmented matrix for this 
system of linear equations. 


rı TOTO? 
r2 LZ $0] $ 
r3 il d $0) $5 
1 Q JUN 2 
[85] —5 185 — TESI 0 2 40) & 
Baro Q il ZI 3 
1 Q T0 2 
ro > jro © 1 20] 2 
0 i 210/ 3 
lL Q TIN 2 
0 1 2/0] 3 
Ligh hos Mo 0 0 0/0 0 


The corresponding system of equations is 
Qa a qr 
B 4 2y — 0. 
The solution set of the system is 
a ——k,f-—-—2k,y—k, kER, 
so there are infinitely many solutions. For example, k — —1 gives 
(it, P2052) 1) — (055-3) = (050.0). 
So this set of vectors is linearly dependent. 


€ Any one of the vectors can be written as a linear combination 
of the other two, for example (1, 1,1) = (1,5,3) — 2(0,2, 1). œ 


We claimed earlier that three non-zero linearly dependent vectors in IR? are 
coplanar and this was the case in Worked Exercise C33(b). You may like 
to check that all the vectors in the set lie in the plane through the origin 
with equation x + y — 2z = 0. 


In the following exercise you are asked to determine whether given sets of 
vectors are linearly independent or not. Before embarking on the algebra, 
have a look at each set of vectors and try to decide whether you expect the 
set to be linearly dependent or linearly independent; it may be that 
Strategy C7 is not needed in some cases. 


3 Bases and dimension 


141 


Unit C2 Vector spaces 


Exercise C57 


Determine whether each of the following sets of vectors is a linearly 
independent subset of V. 


(a) V=R’, ((10)(-1,1)). 

(b) V=R’, {(1,-1), (51, (2). 

(c) V=R%, {(1,1,0), (-1,1,1)). 

(d V-2R?, {(1,0,0), (1,1,0), (1, 1, 1)). 
(e) V=R*, {(1,2,1,0), (0, —1,1,3)). 


We conclude this subsection by looking briefly at linearly dependent and 
linearly independent sets of vectors in vector spaces other than R?, IR? 
and R^. Again, before embarking on the algebra, it is sensible to have a 
look at each set of vectors: it may be that Strategy C7 is not needed in 
some cases. 


Worked Exercise C34 


Determine whether the set of polynomials (1, 4a, 4x + z?] is a linearly 
independent subset of P5. 


Worked Exercise C35 


In each case, determine whether the set S of matrices is a linearly 
independent subset of M» 5. 


e s-(G 3.2 3] 
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px DIS XE 


Solution 


(a) 


€ There are just two matrices and neither is a multiple of the 
other, so the strategy is unnecessary. £9 


The set S is linearly independent because neither matrix is a 
multiple of the other. 


€. The second matrix is a multiple of the first (—2 times), so the 
strategy is unnecessary. £9 


The set S is linearly dependent because 
1 -1 —2 2 
2 j*( 0 EB Jr 
®. There is no obvious linear dependence. © 
We apply Strategy CT. 
We write 
(à j)*s( 0 ec A 3r 
Q 2 —2 1 29 Que) 
which can be written as 
Gee eee 7 
—28 +27 2a+6+4+3y OO 


Equating corresponding entries, we obtain the system 


a 4E 2 = ) 
a] +3y=0 
= 20 Ter 0 


20 B+3y=0. 


€. The first and third equations both simply relate two 
unknowns, so it is sensible to start with these. @ 


From the third equation we have 26 = 2y, that is, 6 = y, and 
from the first equation a = —27. If we choose y = 1, then 6 = 1 
and o — —2, and these also satisfy the second and fourth 
equations; thus 


(0 Ca WG 3)-( 9) 


So we can find a, 6 and y not all zero such that the original 
equation is satisfied. So the set of matrices is linearly dependent. 
It is not a linearly independent subset of M29. 
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Exercise C58 


In each of the following cases, determine whether S is a linearly 
independent subset of the vector space V. 


(a) VP, 8 = {1,g,x?,£3,1 +g +r? +r’, 


o vem sedit 2) (1 9) 
ovens sed D DE D) 


(dj. ext. p47 esf. 


3.2 Bases 


We now use the idea of linear independence to help us find a minimal set 
of vectors that spans a vector space. 


If we have a set of vectors that forms a spanning set for a vector space, 
then the set is a minimal spanning set if and only if it is linearly 
independent. 


'This condition is certainly necessary because, as we showed in the previous 
subsection, if the set of vectors is linearly dependent, then we can write at 
least one of the vectors as a linear combination of the other vectors. Such 
a vector is redundant, and we can drop it from the set, so the set is not a 
minimal set. 


'The condition is also sufficient; we prove this using proof by contradiction. 
Let S = (vi, v2,..., Vg} be a linearly independent spanning set for a 
vector space V, and suppose that the smaller set S1 = [vi,vo,..., Vk 1] 
also spans V. This means we can write any vector in V as a linear 
combination of the vectors in 541. In particular we can write 


Vk = O4V4 +: F Ok-1Vk-1, 
for some o1,..., o. not all equal to 0. Therefore 
avi +--+ + Ok-1Vk-1 — Vk = 0, 


so S is not linearly independent. But this is a contradiction, so our initial 
assumption that $4 spans V must be wrong. Thus $4 cannot span V and 
S is a minimal spanning set. 


If we have a linearly independent set of vectors that spans a vector space, 
then we give the set of vectors a special name. 


Definition 


A basis for a vector space V is a linearly independent set of vectors 
that is a spanning set for V. 


'The plural of basis is bases. A basis of a vector space V is one set of 
linearly independent vectors that spans V; a basis is not unique, so V can 
have many different bases. 


You saw in Exercise C53(a) that ((1, 1), (-1,2)) is a spanning set for R?. 
Since it is also a linearly independent set, it is a basis for R?. Although the 
set (1,0), (1, 1), (1, —2)} is also a spanning set for R?, it is not linearly 
independent, as we showed earlier in this section: so it is not a basis for R?. 
While each vector in R? can be written as a linear combination of vectors 
in the spanning set ((1,0), (1, 1), (1, —2)}, this expression is not unique. 
For example, 

(0,1) = 2(1,0) — 1(1,1) — 1(1, —2) 

= —4(1,0) + 3(1, 1) + 1(1, —2). 

An important property of a basis for a vector space V is that each vector 
in V has a unique expression as a linear combination of basis vectors. 


Theorem C21 


Let S be a basis for a vector space V. Then each vector in V can be 
expressed as a linear combination of the vectors in S in only one way. 


Proof Let S = (vi, vs,..., vx] be a basis for a vector space V. 


$$, We assume that a vector in V can be written as a linear combination 
of v1, V2,..., Vj in two different ways, and show that this leads to a 
contradiction. .£& 


Let u be a vector in V, and assume that we can write u as a linear 
combination of the vectors in S in two different ways as: 


uU = Q{V] + AQV2 +++ d QkVk 


and 

u = fivi + Bove +++: + Breve. 
Then 

0—u-uc (o; — fi)vi + (a2 — 82)va +-+- + (ak — Be) VE, 
and (o4 — £1), (a2 — £83), ..., (ak — Bx) are not all zero. 


Therefore the set S is linearly dependent. But S is a basis for V, and is 
therefore linearly independent. This contradiction shows that 
Theorem C21 is true. E 
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The definition of a basis gives us a strategy for testing whether a given set 
of vectors is a basis for a particular vector space. 


Strategy C8 


To determine whether a set of vectors S in a vector space V is a basis 
for V, check the following conditions. 


(1) S is linearly independent. 

(2) S spans V. 

If both (1) and (2) hold, then S is a basis for V. 

If either (1) or (2) does not hold, then S is not a basis for V. 


Worked Exercise C36 


Show that S = ((2,0,2), (1, 1, 1), (0, 1, —1)} is a basis for R3. 


Solution 
We check both conditions in Strategy C8. 
€. We start by checking condition (1): S is linearly independent. © 
Using Strategy C7, we write 
a(2,0,2) + 8(1, 1, 1) + 4(0, 1, —1) = (0,0,0), 
which simplifies to 
(2a + B, B +7,2a + B — y) = (0,0,0). 


Equating corresponding coordinates, we obtain the system 


2a + B =) 
put 
2a B= y=), 


$3, We could use Gauss-Jordan elimination, but we can solve this 
system directly. £9 


Subtracting the third equation from the first gives y = 0, and 
substituting this into the second equation gives 6 = 0. Finally, 
substituting 8 = 0 into the first equation gives a = 0. The only 
solution isa = B — «y — 0. 

Therefore the set S is linearly independent. 

€. We now check condition (2): S spans RÌ. @& 

We apply Strategy C6. 


€. We need to show that every vector in R? can be expressed as a 
linear combination of the vectors in S, so we show that the general 
vector (x,y,z) can be. & 
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Each vector in R? can be written as (x,y,z), with z, y, z € R. To 
show that (x,y,z) is in (S), we write 


(ao z) = a(2,0, 2) mE B1, i 1) np JO, if =í), 


Equating corresponding coordinates, we obtain the system 


2a +8 =r 
B+y=y 
2a+ B-y=z. 


Subtracting the third equation from the first gives y = x — z, and 
substituting this into the second equation gives 8 = y — x + z. Finally, 
substituting for 8 in the first equation gives a = z(2r —y-—z). We 
have a solution, so any vector in IR? can be written in terms of vectors 
in S as 


(x,y,z) =4(2x — y — z)(2,0, 2) + (y — x + z)(1, 1,1) 
+ (x — z)(0,1, —1). 
Therefore S spans R?. 
Since conditions (1) and (2) hold, the set S is a basis for IR?. 


Worked Exercise C37 


Determine whether each of the following sets is a basis for R. 
(a) {(0,1,2),(1,2,-1)} — (b) 1(5,1,1),(06,2,1),(-1,1,0)] 


Solution 
(a) We check both conditions in Strategy C8. 


The set ((0, 1, 2), (1,2, — 1)) is linearly independent, as neither 
vector is a multiple of the other. 


We apply Strategy C6. 


€. We need to show that every vector in R? can be expressed as 
a linear combination of the given vectors, so we show that the 
general vector can be. © 


Each vector in R? can be written as (x,y,z), with x,y,z € R. To 
show that (x,y,z) is in (((0, 1,2), (1,2, —1)]), we write 


(Gag; z) ES a(0, il 2) T Bb 2, xu 


Equating corresponding coordinates, we obtain the system 


IgE 
quc =y 
2a — B=z. 
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Substituting 6 = x from the first equation into the other two 
equations gives 


[o ETE 

a= (xz + z). 
®. The vector (x,y,z) is a general vector, so we need a solution 
for every possible combination of x, y and z. & 


These two equations are true simultaneously if and only if 
y— 2r = $(a + z); that is, if and only if 5r — 2y + z = 0. 


®. This is not true for every x, y and z. In fact, it shows that 
({(0, 1, 2), (1,2, —1))) is the plane 52 — 2y 4- z = 0 in R5; thus any 
point not on this plane cannot be written as a linear combination 
of the vectors (0,1,2) and (1,2, —1). @ 


This contradicts the assumption that x, y and z can take any 
real values, so ((0, 1,2), (1, 2, —1)) is not a spanning set for R?. 
Thus it is not a basis for IR?. 


(b) We check both conditions in Strategy C8. 


®. Before diving into Strategy C7, we quickly look at the given 
vectors to see if there is any obvious linear dependence. $9 


Here we have 
(—1,1,0) = —(1,1,1) + (0,2, 1), 
so these vectors are not linearly independent. 


Therefore the set {(1, 1, 1), (0, 2, 1), (—1,1,0)} is not a basis 
for R. 


Exercise C59 


Determine whether each of the following sets is a basis for IR?. 
(a) {(0, 1,2), (0,2, 3), (0,6, 1)} 
(b) qc 2, Dy (1, 0, —1), (0, 3, 1)} 
(c) 1(1,0,0), (0,1,0), (0, 0, 1), (1, 1, 1)] 
Exercise C60 


Determine whether ((1,2, —1, — 1), (—1, 5, 1,3)} is a basis for R4. 


We now consider bases for vector spaces other than R?, IR? and R£. 


Worked Exercise C38 


Determine whether each of the following sets is a basis for P3. 
(a) (2,27) (b) {LaF (©) (5,292527) 


Solution 


(a) 


We check both conditions in Strategy C8. 
€. We check whether 11,2, x7} is linearly independent. © 
Using Strategy C7, we write 

al + Bx + ya? = 0-E Or + 0z?. 


Comparing coefficients, we have a = B = y = 0 as the only 
solution, so the set is linearly independent. 


€. We check whether {1, 2,27} spans Py. © 
We apply Strategy C6. 


®. We need to show that every vector (polynomial) in P3 can be 
written as a linear combination of 1, z and x”, so we show that 
the general vector a + br + cx? can be. & 


Each vector in P3 can be written as a+ bx + cz?, with a,b,c € R. 
To show that a + bx + ca? is in ({1,x,x?}), we write 


a+ bz + cz? = a(1) + B(x) + (a). 
Equating coefficients, we see that a= a, b= B andc=y. 
Therefore the set of vectors spans P3. 
Thus (1,2, 27} is a basis for P3. 


®. Notice that x? cannot be expressed as a linear combination of 
land z. # 


None of the vectors contains an z? term, so the set (1, x} does 
not span P3. 


Therefore this set of vectors is not a basis for P3. 


€. You may have noticed that neither vector is a multiple of the 
other, so the set (1, x) is linearly independent. The span of this 
set consists of polynomials of the form a + bx, which is a proper 
subset of P3. & 


Here we have 

2+ 2^ = 2(1) + 1(z^), 
so the set (1,2 + 22, z?) is not linearly independent. 
Therefore (1,2 + z?, x7} is not a basis for P5. 


€. The span of this set consists of all polynomials of the form 
a + bx?, which again is a proper subset of P4. ® 
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Figure 9 An ellipse with 
non-standard basis shown 
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Exercise C61 


Determine whether 


esce 


is a basis for M22. 


3.3 Standard bases 


You may have noticed that some sets of basis vectors seem to make the 
calculations in vector spaces particularly simple. For R? this set is 
{(1,0), (0, 1)), for R? it is ((1,0,0), (0, 1,0), (0,0, 1)), and so on. 


'The representation of a vector in terms of these bases is straightforward. 
For example, in R? 


(x,y) = x(1,0) TE y(0, 1); 
and in IR? 
(x,y,z) = x(1,0,0) + y(0, 1,0) + z(0,0, 1). 


Because these bases are so simple, they are used frequently; they are called 
standard bases. 


Definition 
The standard basis for R” is the set of n vectors 


(GEO REOS OIN NS PEU] | (SEDIS 


The standard basis for R” seems so natural that you may wonder why we 
do not use it all the time. In some physical situations, however, we may 
need to choose a different basis. For example, if we are looking at an 
ellipse centred at the origin, we may want to choose basis vectors along the 
major and minor axes of the ellipse. For the ellipse shown in Figure 9, it 
may be more convenient to choose the basis vectors (1,1) and (—1, 1) 
rather than the standard ones, (1,0) and (0, 1). Similarly, if we are 
considering a parallelogram, we may want to choose basis vectors along the 
sides of the parallelogram. In many vector spaces other than IR" there are 
particularly simple bases, which we call the standard bases for these 
spaces. Here are some examples. 


Por TL ee 
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If we write a vector in R? as (x,y), then x and y are the components, or 
coordinates, of the vector with respect to the standard basis vectors — that 
is, 

(x,y) = x(1,0) + y(0, 1). 


However, we need some way of indicating what the coordinates of a vector 
are with respect to non-standard basis vectors. We use the following 
notation. 


Definitions 


Let E = {e1,€2,...,@n} be a basis for a vector space V, and suppose 
that 


Y = Vien F e ane, 

where v1, U2,..., Un E R. 

Then the E-coordinate representation of v is 
Wig = (v1, v2, M ; Un) E- 


We call v1, v2,..., v, the coordinates of v with respect to the 
basis E, or, more briefly, the E-coordinates of v. 


Remarks 


1. We usually omit the subscript if E is the standard basis. 


2. We write the basis vectors as (e1,e5,...,e4) rather than 
[vi, V2,..., Vn} to avoid confusion between the basis vectors and the 
coordinates v1,V2,...,Un of a vector v. 

3. We can denote the E-coordinates of a vector vj by Vij, v5j,..., Unj. SO 


we write vj = v1je1 + voje3 +--+ + Unjen. 


4. Since E is a basis for V, the E-coordinate representation of a vector 
in V is unique. However, the order of the coordinates in such a 
representation depends on the order of the basis vectors. 


5. A non-zero vector has a different coordinate representation for each 
different basis. For the zero vector, the coordinates are always zero. 


You can think of the different representations of a vector as analogous 
to an amount of money being expressed in different currencies; in every 
currency, ‘no money’ is the same as ‘zero money’. 


6. If E is a standard basis, then we refer to the standard coordinate 
representation, standard coordinates, and so on. 


The following worked exercise shows this notation in practice. 
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Worked Exercise C39 


Given the basis E = ((—1,2), (2,2)} for R2, determine the standard 
coordinate representation of (3, 2) p. 


Exercise C62 
(a) Given the basis E = {(1, 2), (C3, 1)) for R?, determine the standard 


coordinate representation of (2, 1) p. 


(b) Given the basis E = ((1,0,2), (—1, 1, 3), (2, —2,0)) for RÌ, determine 
the standard coordinate representation of (1, 1, —1)g. 


We can also turn around the method in Worked Exercise C39 to express a 
given vector in terms of a non-standard basis. 


Worked Exercise C40 


For each of the following bases E for R?, find the E-coordinate 
representation of the vector (1, 4). 


(a) E= {(1,4), (4, zi (b) E- 1-13), (2, 2)} 


(b) We write (1,4) = a(—1,2) + 8(2,2) = (—a + 28, 2a + 28). 
Equating corresponding coordinates, we obtain the system 


et em 
2a +28 — 4. 


Solving these equations gives œa = 1 and f = 1, so 


(1,4) = 1(-1,2) + 1(2, 2) = (1, De. 


Geometrically, by changing the basis we are changing the axes we are 
using. For example, in Worked Exercise C40(b) we are expressing the 
vector (1,4) (with respect to the standard basis) as a vector in terms of 
the new basis vectors E = {(—1, 2), (2,2)}. The E-coordinates of this 
vector with respect to the basis E are (1, 1)g representing one step along 
the (—1,2)-axis then one step along the (2,2)-axis. Figure 10 illustrates 
how this vector is represented with respect to these new axes. 


Worked Exercise C41 


Find the E-coordinate representation of the vector (—2,0,1) with respect 


to the basis E = ((1,0,0), (1,0, 1), (2, 1, —1)) for R3. 


Solution 


We write 
(—2,0,1) = oa(1,0,0) + 8(1,0, 1) + ¥(2, 1, — 1) 
Equating corresponding coordinates, we obtain the system 
a+ l + 2y = —2 
y=0 
p= wed 
The second equation gives y = 0. Substituting this value into the 
third equation gives 6 = 1, and substituting these values into the first 
equation gives a = —3. So 
(—2, 0,1) = —3(1, 0,0) + 1(1, 0, 1) + 0(2, 1, — 1) 
= (=3, We 0)g. 
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Exercise C63 


(a) Find the E-coordinate representation of the vector (5, —4) with 
respect to the basis E = {(1, 2), (—3,1)} for R?. 


(b) Find the E-coordinate representation of the vector (—3,5, 7) with 
respect to the basis E = {(1,0, 2), (—1,1,3), (2, —2, 0)} for R3. 


3.4 Dimension 


You may have noticed in the previous subsection that all the bases you met 
for R? contained two vectors, all the bases for IR? contained three vectors, 
and so on. This should correspond to your intuitive idea of dimension — 
namely that R is one-dimensional, R? is two-dimensional, and so on. 


For example, among the bases you met were the following. 
R^«((0,0, (0/0). 10,9, 00D). (52.0750). 
R?: {(1, 0,0), (0,1,0), (0,0,1)}, 1(1,2,1), (1,0, 21), (0,3, 1)}. 
Rt : ((1,0,2, 0), (0, 1,0, 3), (0,0, 1, 2), (2,0, -1, 0)}, 
{(1,0,0,0), (0,1,0,0), (0,0, 1,0). (0,0,0, 1)}. 


It is not a coincidence that every basis for R? contains exactly two vectors, 
and every basis for R contains exactly three vectors. The main theorem in 
this section, the Basis Theorem, states that if V is any vector space, then 
every basis for V contains the same number of vectors. Before we prove 
this, we must define what we mean by a finite-dimensional vector space. 


Definitions 


Let V be a vector space. Then V is finite-dimensional if it contains 
a finite set of vectors S that forms a basis for V. If no such set exists, 
then V is infinite-dimensional. 


Examples of infinite-dimensional vector spaces are IR?? and the set of 
polynomials of any degree. On the other hand, the set containing just the 
zero vector is a zero-dimensional vector space, which has the empty set as 
its basis. 


In order to prove that every basis for a finite-dimensional vector space V 
contains the same number of vectors, we first prove the following useful 
result. 


Theorem C22 


Let E = (e1,e5,...,e,] be a basis for a vector space V, and let 
S = (vi, va,..., Vm] be a set of m vectors in V, where m > n. Then 
S is a linearly dependent set. 


Proof €, We assume that the conditions of Theorem C22 hold and show 
that this implies that S is linearly dependent. .$ 

Let E = {e1,€2,...,€n} be a basis for V, and let S = (vi, vs,..., Vm} be 
a set of m vectors in V. Then each of the vectors v1, v2,..., v4, can be 
written as a linear combination of the vectors in E; that is, 


Vi = V11€1 + U91€2 t +++ + Unien, 


V2 = V12€1 + U22€2 + +++ + Un2en, 


Vm = Vime1 + Vome + 77: + Unmen; 
for some numbers v14,..--,Unm € R. 
'To show that S is linearly dependent, we must find real numbers 
01,02, ..., O5, not all zero, such that 
Q4V4 + Q2V2 +- + Og Vg, = 0. (1) 
Using the first system of equations, we can rewrite equation (1) as 
(aivi + 02312 9 +++ + e t1m)e1 


+ (a1v21 + 03022 +++: + o 725 )e2 


Tec (Q1Un1 + a2Un2 ec AmUnm)en = 0. (2) 
Since E is a basis, the set of vectors (e1,e5,...,e,) is linearly 
independent. It follows that we can find real numbers aj, Q2,...,Qm, not 
all zero, that satisfy equation (2) if and only if the following system of 
equations has a non-zero solution for 04,02,..., Qm: 

U1104 + U12032 + +++ t VimAm = 0 

U3104 + U220 + +++ + VamAm = 0 

Un1Q1 + Un20 + +++ + Ung Om = 0. 


This is a system of n linear equations in m unknowns with m > n, so there 
are more unknowns than equations. 


$$. In Unit C1 you saw that a consistent system with more unknowns than 
equations has an infinite solution set. The system above is consistent 
because it is homogeneous, and therefore it has an infinite solution set. $$ 


Such a system of linear equations has a non-trivial solution — that is, 

a solution for which some variables are non-zero. Therefore the 

set S containing m > n vectors is linearly dependent. This proves the 
theorem. B 
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For example, R? has three vectors in its standard basis, so, by 
Theorem C22, the set 


11, im 0), (0, =2; 1), (0, 0, 1), (1, 1, 2)} 
is linearly dependent because it contains more than three vectors. In fact, 
(1, L 0) + 0(0, —2, 1) T 2(0, 0, 1) m (1, 1, 2) m (0, 0, 0). 


Theorem C22 has the following immediate, and useful, consequence. 


Corollary C23 


Let V be a vector space with a basis containing n vectors. If a linearly 
independent subset of V contains m vectors, then m < m. 


'This corollary provides the crucial steps in the proof of the Basis Theorem. 


Theorem C24 Basis Theorem 


Let V be a finite-dimensional vector space. Then every basis for V 
contains the same number of vectors. 


Proof ®. We assume there are two bases with n and m vectors, 
respectively, and show that since a basis is a linearly independent set, this 
implies that n =m. f$ 


Let (e1,e5,..., €n} and (fi, f2, ..., fm} be two bases for a 
finite-dimensional vector space V. 


Since {e1,e2,...,@n} is a basis for V and (fi,f»,..., fm} is a linearly 
independent set, we have m < n, by Corollary C23. 


Similarly, since (f1,f2,..., fm} is a basis for V and {e1,e2,...,e,} is 
linearly independent, we have n < m, by Corollary C23. 


Therefore m = n, so every basis contains the same number of vectors. E 


'The Basis Theorem allows us to give a definition of the dimension of a 
finite-dimensional vector space, which agrees with our intuitive idea of 
dimension. 


Definition 


'The dimension of a finite-dimensional vector space V, denoted by 
dim V, is the number of vectors in any basis for the space. 


So R? has dimension 2 and IR? has dimension 3, as we would expect. More 
generally, R” has dimension n, since the standard basis for IR" has n 
vectors. It follows from Theorem C24 that every basis for IR" contains 
exactly n vectors. The strategy for checking whether a set of vectors is a 
basis (Strategy C8) can now be greatly simplified when the vector space is 
R”. The result that we need is stated in the next theorem. 


Theorem C25 


Let V be an n-dimensional vector space. Then any set of n linearly 
independent vectors in V is a basis for V. 


Proof €, We give a proof by contradiction. . 


Suppose that the set S = (vi, vo, ..., Vn} of n linearly independent vectors 
does not span V. Then there exists a vector v in V that cannot be written 
as a linear combination of the vectors in S. 


So, if 
Vi T ::: d Og Vg + Antiv = 0, 
then «44 = 0, since v cannot be written as a linear combination of the 


vectors in S and o4 = ::: =a, = 0, since S is linearly independent. Hence 
[vi V2,..., Vn, V] is a linearly independent set of vectors. 


But by Theorem C22, any set of more than n vectors is linearly dependent. 
This is a contradiction so the original statement must be false, and S does 
span V. 


Therefore every set of n linearly independent vectors in V is a basis 
for V. E 


This means that to check whether a set S is a basis for R”, we no longer 
have to check that S spans R”: we know that it does if it is linearly 
independent and contains n vectors. We can simplify Strategy C8. 


In fact, we can use this simplified strategy to determine whether a set of 
vectors is a basis for any vector space V if we know the dimension of V. 


Strategy C9 


To determine whether a set of vectors S in a vector space V of 
dimension n is a basis, check the following conditions. 


(1) S contains n vectors. 
(2) S is linearly independent. 


If both (1) and (2) hold, then S is a basis for V. 
If either (1) or (2) does not hold, then S is not a basis for V. 
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Exercise C64 


Use Strategy C9 to determine which of the following sets is a basis for R?. 
(a) {(1,2,1),(1,0,-1)} — (b) {(1,0,1), (1,0, 1), (0,1, 1)} 

(c) {(1,—1, 0), (2, 1, 4), (3,0, 4) 

(d) {(1, 0,0), (0, 1,0), (0,0, 1), (1,1, 1)] 


Strategy C9 is easier to use than Strategy C8 because you can eliminate 
sets that do not contain the right number of vectors. Furthermore, you do 
not need to check spanning, which is usually harder than checking for 
linear independence. 


To be able to apply Strategy C9 to vector spaces other than IR" we need to 
know the dimension of other vector spaces. 


In Subsection 3.3 we listed the standard bases for some vector spaces as 
follows. 


R”: 4{(1,0,...,0),(0,1,0,...,0),...,(0,...,0,1)}. 
Pa: disque th 


w (03.626969) 


C: Li. 
We can see that the dimension of P, is n, so the dimension of P is 2, the 
dimension of P3 is 3, and so on. 


Similarly, the dimension of M» » is 4, and, in general, the dimension of 
Mm,n is mn. For example, M» 3 has dimension 6: a basis is 


100 0 1 0 0 0 1 

0 0 0/’\0 0 0/°\0 0 OF’ 

0 0 0 0 0 0 0 0 0 

1 0 0/'10 1 0/'10 0 1/7]' 
Finally, the dimension of C is 2. 


Exercise C65 


Use Strategy C9 to determine whether each of the following sets is a basis 
for the given vector space. 


(a) The set S for M55, where 


:- (623. 3.6 3:6 2) 


(b) The set S = {2 + x,1 — z} for P». 


We end this section by showing that a linearly independent subset of a 
vector space can always be extended to give a basis for the vector space. 
This result will be useful in Unit C3 Linear transformations. 


Theorem C26 


Let S = (vi, v5,..., V] be a linearly independent subset of an 
n-dimensional vector space V, where m « n. Then there exist vectors 
Vivi such that vivo vn 1s 4 basis tor Y: 


Proof Since m « n, S is not a basis for V, by the Basis Theorem 
(Theorem C24) and Theorem C25. Thus there is a vector Vm4i in V that 
cannot be expressed as a linear combination of the vectors in S. As in the 
proof of Theorem C25, it follows that (v1, v2,...,Vm4+1} is linearly 
independent. 


We keep adding vectors in this way until we obtain a linearly independent 
set with n vectors. This is a basis, by Theorem C25. | 


4 Subspaces 


In this section you will meet subsets of vector spaces that are themselves 
vector spaces. 


4.1 Definition 


You have seen examples where a set of vectors does not span the whole of 
a vector space, but spans only a proper subset of that vector space, for 
example in Worked Exercise C32 and Exercise C56. In particular, you saw 
the following. 


e In R?, the set of vectors {(1,1)} is a spanning set for the line through 
the origin with equation y = x; this is a one-dimensional subset of R?. 


e In R?, the set of vectors {(1,0,0)} is a spanning set for the x-axis; this is 
a one-dimensional subset of R3. 


e In R?, the set of vectors {(1, 0,1), (2,0,3)} is a spanning set for the 
plane y = 0; this is a two-dimensional subset of IR?. 


In fact, any proper subset of IR? that is the span of a set of vectors must 
take one of the following forms: {0}, a line through the origin (a 
one-dimensional subset), or a plane through the origin (a two-dimensional 
subset). 


When you met these examples, you may have asked yourself whether these 
subsets are themselves vector spaces. In fact, they are; we call such subsets 
subspaces. 
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Definition 


A subset S of a vector space V is a subspace of V if S is itself a 


vector space under vector addition and scalar multiplication as 
defined in V. 


In order to prove that a subset S is a vector space, we must show that it 
satisfies all the axioms in Subsection 1.2. In practice, however, we do not 
need to check them all, as many of them carry over from V; that is, if they 
are true for V, then they are also true for S. For example, the 
commutativity axiom (A5) states that vı + vo = v2 + v1, for all vj, v2 € V; 
since all the vectors in S are also in V, this axiom holds for S. 


Provided that S is non-empty, the only axioms that need to be checked are 
the closure axioms (A1 and S1), because all the other axioms follow 

from V. If the zero vector is in S, then S is non-empty. Therefore we can 
replace the condition that S is non-empty by the condition that the zero 
vector is in S. This gives the following theorem; you are asked to prove 
this as an exercise in the additional exercises booklet for this unit. 


Theorem C27 


A subset S of a vector space V is a subspace of V if it satisfies the 
following conditions. 


(a) OES. 
(b) S is closed under vector addition. 


(c) S is closed under scalar multiplication. 


'This theorem allows us to give a strategy for testing whether a given 
subset of a vector space is a subspace. 


Strategy C10 


To test whether a given subset S of a vector space V is a subspace 
of V, check the following conditions. 


(1) 

(2) If vi, v2 € S, then vı + v2 € S (vector addition). 

(3) If v € S and a € R, then av € S (scalar multiplication). 

If (1), (2) and (3) hold, then S is a subspace of V. 

If any of (1), (2) or (3) does not hold, then S is not a subspace of V. 


0 € S (zero vector). 


The following worked exercises and exercises illustrate how this strategy is 
used to show that a given set is a subspace. 
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Worked Exercise C42 


Show that the set of vectors S = {(x, 3x) : x € R} is a subspace of R?. 
Sketch this subspace. 


Solution 
The set S is a subset of R?, so we use Strategy C10. 
€. We first check condition (1): 0 € S. #& 
If z = 0, then (z,3z) = (0,0), so S contains the zero vector of R?. 
€&. We check condition (2): If v1, v2 € S, then vi + vo c S. f$ 
Let vı = (21,321) and v2 = (12,322) belong to S. Then 
Vi V3 = (21,321) + (22,322) 
= (41 + 22,321 + 322) 
= (£1 + £2, 3(x1 + 22)). 


This vector has the correct form for a vector in S, since 71 + z2 € R, 
so S is closed under vector addition. 


€. We check condition (3): If v € S and a € R, then ov € S. & 
Let v = (z, 32) € S and o € R. Then 


Ov = or no ap) = (ax tora res (an, ev s 


This vector has the correct form for a vector in S, since ox € R, so S 
is closed under scalar multiplication. 


Since conditions (1), (2) and (3) are satisfied, S is a subspace of R?. 
This subspace is the line through the origin with equation y = 3x. 


Exercise C66 


Show that the set of vectors S = ((z, —2z) : x € R} is a subspace of R?. 
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Worked Exercise C43 


Show that the set of vectors S = {(x, y, 2x — 3y) : x, y € R} is a subspace 
of IR?. 


Solution 
The set S is a subset of R?, so we use Strategy C10. 
If z = y = 0, then (x, y, 2z — 3y) = (0,0,0), so S contains the zero 
vector of IR?. 
Let vi = (£1, Y1, 221 — 3y1) and ve = (#2, yo, 215 — 3y3) belong to S. 
'Then 
vı + V2 = (z1,91,221 — 331) + (22, yo, 222 — 3y2) 
= (x1 + 2, y1 + 92,221 — 3y1 + 2x2 — 3yz) 
= (x1 + 2, y1 + 92, 2(x1 + 22) — 3(y1 + y2))- 
This vector has the correct form for a vector in S, since 
zı + x2,91 + yo € R, so S is closed under vector addition. 
Let v = (2, y, 2x — 3y) € S and o € R. Then 
av — a(z,y, 2x — 3y) 
= (az, ay, o(2x — 3y)) 
= (ax, ay, 2(ax) uS 3(ay)). 
This vector has the correct form for a vector in S, since az,ay € R, 
so S is closed under scalar multiplication. 


Since conditions (1), (2) and (3) are satisfied, S is a subspace of R?. 


€. S is the set of points in RÌ satisfying z = 2x — 3y; it is the plane 
through the origin with equation 2x — 3y — z = 0. & 


Strategy C10 is used in much the same way to determine whether a given 
subset is a subspace. However, since if any one of the conditions fails then 
the subset is not a subspace, it may be that only one of the conditions 
needs to be checked. 


Worked Exercise C44 


For each of the following, determine whether the set S is a subspace of the 
vector space R°. 


(a) S={(@,y,a-—y+2):a,yEeR} (b S—l(-wwz):wzeRj 
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Solution 
In each case the set S is a subset of IR?, so we use Strategy C10. 


(a) If 0 € S, then (z, y, x — y+ 2) = (0,0,0) for some numbers x and 
y. Equating corresponding coordinates, we obtain the system 
ae =0 
y 0 
R= em. 
This system is inconsistent so has no solution. Therefore 0 does 


not belong to S and condition (1) is not satisfied. Hence S is not 
a subspace of R?. 


®. Since condition (1) is not satisfied, we do not need to check 
conditions (2) and (3). However, neither is satisfied, and either 
one could have been used to show that S is not a subspace. .9 
(b Ify2z-0,then (z— y, y, z) = (0,0,0), so S contains the zero 
vector of IR?. 
Let vi = (z1— yi, Y1, z1) and v2 = (22 — y2, Y2, 22) belong to S. 
'Then 
Vi + V2 = (21 — Y1, Y1, 21) + (22 — Y2, Y2, 22) 
= (z1 — yi + 22 — Y2, Y1 + Yo, 21 + 22) 
= ((z1 + 22) = Qni + va) y1 + yo, 21 22). 
This vector has the correct form for a vector in S, since 
Yı ye, 21 + z2 € R, so S is closed under vector addition. 
Let v —(z—y,y,z) € S and a € R. Then 
GV a(z us V9) 
z (a(z T y); ay, az) 
= (az — ay, ay, oz). 
'This vector has the correct form for a vector in S, since 
ag, oz € R, so S is closed under scalar multiplication. 


Since conditions (1), (2) and (3) are satisfied, S is a subspace 
of IR?. 


€. S is the set of points in IR? satisfying z = x + y; it is the plane 
through the origin with equation z + y — z = 0. £8 


Exercise C67 
For each of the following, determine whether the set S is a subspace of the 
vector space V. 
(a) V-R?, S={(2,2+2):c2€R}. 
(b V=Rt, S={(z,y,z,0 + 2y—z):2,y,z E R}. 
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Worked Exercise C45 


Determine whether the set S = {a cos x : a € R} is a subspace of the vector 
space V = {a cosx + bsinz : a,b € R}. 


(We showed that V is a vector space in Subsection 1.2.) 


Exercise C68 


For each of the following, determine whether the set S is a subspace of the 
vector space V. 


(a V=P3, S-—líactbr:a,b € R}. 
(b) V=P3, S={r+ar:a €R}. 


(c) V = Ma, sei I) oder} 


The following theorem shows that the span of a subset of a vector space is 
always a subspace. 


Theorem C28 


Let S be a non-empty finite subset of a vector space V. Then (S) is a 
subspace of V. 
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Proof Let S = (uj, u5,..., Un} be a non-empty finite subset of a vector 
space V. Then the set (S) is a subset of V since V is closed under vector 
addition and scalar multiplication. 

€. We apply Strategy C10. .$ 


The span (S) contains the zero vector, since Ou; + Ouz +---+0u, = 0 
belongs to (S). 

Let v; = a1Uu4 + a3u» + -:: + anUn and vz = b1u4 + b2U2 +---+b,u, be 
any two vectors in ($). Then 


Vi + v3 = (a1u4 + a2U2 +--+ + anUn) + (bru, + bu» +--+ + bus) 
= (a4 + 51)u; + (a2 + 52)ug +--+ + (an + bn)Un. 
This is a member of (S), since it is a linear combination of u1, Ug,..., Un. 


Hence (5S) is closed under vector addition. 
Let v = au; + a2U2 + : +- + anUn and a € R. Then 
av = a (au; + a2U2 +--+: + anun) 
= (aaı)uı + (oa2)us +--+ + (aan)un. 


This is a member of (S), since it is a linear combination of uj, u2, ... , Un. 
Hence (5S) is closed under scalar multiplication. 


Thus (S) is a subspace of V. El 


4.2 Bases and dimension 


In the previous subsection you saw several subspaces of finite-dimensional 
vector spaces. Since these subspaces are all vector spaces in their own 
right, they have bases and dimensions, and we look at these in this 
subsection. 


Let us return to two of our earlier examples from Section 2: Worked 
Exercises C32(a) and (b). (a, a) 


By Theorem C28, we now know that the set of vectors in R? spanned by 
the set S = {(1,1)} is a subspace of R?. In Worked Exercise C32(a) we (1,1) 
saw that any vector in this subspace (S) can be written in the form (a, a) 
for some a € R; so the set {(1,1)} is a basis for this subspace. Thus the 
dimension of the subspace is 1. T'his agrees with our intuitive idea of Figure 11 The 
dimension: we saw that these vectors form a line through the origin - the ^ one-dimensional subspace 
line y = x, as shown in Figure 11 — which is one-dimensional. ({(1, 1)}) 


Sv 


Similarly, from Worked Exercise C32(b) the set of vectors in R3 spanned 
by the set S = {(1,0, 1), (2,0,3)} is a subspace of IR?. This subspace (S) 
consists of those points of R? of the form (a,0,z). Since the set 

{(1,0, 1), (2,0, 3)) spans the subspace and is linearly independent (the 
vectors are not multiples of each other), it is a basis for this subspace. 
Since there are two vectors in the basis, the dimension of the subspace is 2. 
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Again, this links the idea of dimension in linear algebra to our intuitive 
idea of dimension: we saw that the subspace spanned by these two vectors 
(2,0,3) is a plane through the origin — namely, the plane y = 0, as shown in 
Figure 12 — which is two-dimensional. Since any vector in the subspace can 
be written in the form (z,0,z), we can find another basis for this subspace 
(M by writing 


(z,0, z) = z(1,0,0) + z(0,0, 1). 
This means that the set {(1, 0,0), (0,0, 1)) is another spanning set for the 


cy 


" subspace and, as it is also linearly independent, it is a basis for the 
Figure 12 The subspace. This basis has the additional advantage that it is orthogonal, 
two-dimensional subspace which means that the basis vectors are at right angles to each other. We 
({(1, 0, 1), (2,0, 3)]) will return to orthogonal bases in Section 5. 


In the following worked exercises and exercises we consider various 
subspaces of R? and R^ and look at their bases and dimension. 


Worked Exercise C46 


Find the equation of the subspace of R? spanned by the set 
{(1, 0,2), (2,3, 4)}. 


Solution 


®. The two vectors are not multiples of each other, so they are 
linearly independent. £9 


Since ((1,0, 2), (2, 3, 4)] is a linearly independent set, the subspace it 
spans is a two-dimensional subspace of R? (by Theorem C25). 


€3. A two-dimensional subspace is a plane, and since the zero vector is 
in the subspace this plane must pass through the origin. © 


The subspace is therefore a plane through the origin with equation 
ax + by + cz = 0, 
where a, b, c are not all zero. 


Since the vectors in the spanning set lie in the plane, the values of a, b 
and c must satisfy the system 


a +2c=0 
2a + 3b + 4c = 0. 


The first of these equations gives a = —2c, and substituting this into 
the second equation gives b = 0; so the subspace is the plane with 
equation —2cx + cz = 0, or, equivalently, 


ip — m = (0 
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Exercise C69 


Find the equation of the subspace of IR? spanned by the set 
{(, —2, 0), (0, 3, 3)}- 


Worked Exercise C47 


Find a basis for the subspace S = {(z—y,y,z) : y,z € R} of R3, and hence 
write down the dimension of S. 


(You showed that S is a subspace of IR? in Worked Exercise C44(b).) 


Exercise C70 


Find a basis for the subspace 
S = {(x,y,z,£ + 2y — 2) : x,y,z E R} 
of Rt, and hence write down the dimension of S. 
(You showed that S is a subspace of R* in Exercise C67(b).) 
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Worked Exercise C48 


Find a basis for the plane x — 3y + 2z = 0 (a subspace of R?). 


The following result, which will be used in Unit C3, has been illustrated by 
the worked exercises and exercises in this subsection. For example, in 
Worked Exercise C47 we had V = R®, so dim V = 3 and 

dim $ = 2 < dim V. 


Theorem C29 
The dimension of a subspace of a vector space V is less than or equal 


to the dimension of V. 


Proof Let V be a vector space of dimension n, and let S be a subspace 


of V. Suppose that the dimension of S is m, and let {e1,e2,...,@m} bea 
basis for S. Then {e1,e2,...,@m} is a linearly independent set of vectors 
in V. Thus m € n by Corollary C23. Li 


5 Orthogonal bases 


In this section you will look at bases in which the basis vectors are all 
orthogonal to each other. 


5.1 Orthogonal bases in R? 


Suppose that we wish to express the vector (10,0,4) in R? in terms of the 
basis 


{(2, 1,1), (1, —4, 2), (—2, 1, 3)). 
Using the method given in Subsection 2.1, we first write 


(10, 0,4) = a1 (2,1,1) + a2(1, —4, 2) + a3(—2, 1,3). 


Equating corresponding coordinates gives the system 
2a, + ag — 2a3 = 10 
ay, — 4o» + a3 = 0 
a, + 202 + 303 = 4. 


We can solve this system using Gauss—Jordan elimination or directly, to 
obtain the solution 


Q1 — 4, az = $, a3 = —5. 
Thus 
(10,0, 4) = 4(2,1,1) + £(1, —4, 2) — 1(-2,1,3). 


In this section you will see that there is a simpler method than this that 
involves scalar products of vectors. It can be used when, as here, the given 
basis is an orthogonal basis. In this subsection we concentrate on IR?. 


We start by recalling from Unit A1 the definition of the scalar product in 
IR?, and then use this to define the term orthogonal. 


Definitions 
Let vi = (21,91, 21) and v2 = (2, y2, 22) be vectors in R3. 
The scalar product of vı and v2 is the real number 

V1: V2 = X132 t Y1Y2 + 2122. 


The vectors vı and v2 in R? are orthogonal if vı - vo = 0. 


For example, the vectors vı = (2,1, 1) and v2 = (—2,1,3) are orthogonal, 
since 


vi V2 =2 x (-2)4+1k14+1x3=-441+3=0. 


Geometrically, this means that the vectors vı and v» are at right angles to 
each other, as shown in Figure 13. 


Exercise C71 


(a) Show that (2,1, 1) and (1, —4, 2) are orthogonal. 
(b) Determine which pairs of the following vectors are orthogonal: 


vı = (—2,6,1), v2 = (9,2,6), v3 = (4, —15,—1). 


Definition 


A set of vectors in R? is an orthogonal set if every pair of distinct 
vectors in the set is orthogonal. 


5 Orthogonal bases 


Figure 13 The orthogonal 
vectors vı = (2, 1, 1) and 
V2 = (—2, I; 3) 
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For example, (vi, v2) is an orthogonal set if vı - v2 = 0; we have therefore 
shown above that ((2, 1, 1), (1, —4,2)) is an orthogonal set. 


Similarly, (vi, v2, v3) is an orthogonal set if 
VqQ* V2 = V4 * V3 = V2 ° V3 = 0. 
So ((2, 1, 1), (1, —4, 2), (-2, 1, 3)) is an orthogonal set since 
(1,42) (21,3)  —2 446 5:9, 
and we have shown that (2,1, 1) - (1, 4,2) = 0 and (2,1, 1) - (C2, 1,3) = 0. 


One of the most useful features of orthogonal sets of non-zero vectors is 
their linear independence. The following proof is for sets of three non-zero 
vectors, but a similar proof applies to other numbers of vectors and indeed 
to orthogonal sets of vectors in R”. 


Theorem C30 


Let (v1, V2, v3} be an orthogonal set of non-zero vectors in R3. Then 
V1, V2 and v3 are linearly independent. 


Proof ®. To show that v1, v2 and v3 are linearly independent we need 
to deduce that if a1vı + a2v2 + a3v3 = 0 then o4 = a» = a3 = 0 by using 
the properties of scalar products. .$ 


Suppose that 
Q1V1 + a2 v3 + agv3 = 0. 

We form the scalar product on both sides of the equation with vj: 
vı * (o1 v1 + Q2Vv2 + a3v3) = vı +0 =0. 

Using the multiples property of the scalar product (Unit A1) we get 
oa (vi * v1) + a2(vi * v2) + oa(vi * va) = 0. 


Since (vi, V2, v3} is an orthogonal set of non-zero vectors in IR?, we know 
that 


vi1* Vi £0, vi- va =0, vi- v3 =0, 
so we have o4 (vi - v1) = 0 and thus a; = 0. 
Similarly, we form the scalar product with v2 and va: 
V2 * (o1V1 + a2 v2 + o3V3) = v2 0 = 0, 
which gives ag = 0; 
v3 * (a1v1 + Q2Vv2 + a3V3) = v3: 0 = 0, 
which gives a3 = 0. 
We conclude that if o4 v4 + agv2 + a3Vv3 = 0 then o4 = o» = o3 = 0. 


Thus (vi, V2, v3} is a linearly independent set. L| 


This result leads to the idea of an orthogonal basis. 


You have seen that any linearly independent set of three vectors in R? is a 
basis for R?. Now, if we have an orthogonal set of three non-zero vectors in 
R, then we know from Theorem C30 that the set is linearly independent, 
so the set is a basis for IR?. We call an orthogonal set that is a basis an 
orthogonal basis. 


Theorem C31 


Any orthogonal set of three non-zero vectors in IR? is an orthogonal 
basis for R3. 


For example, the standard basis ((1, 0, 0), (0, 1,0), (0,0, 1)) for R? is an 
orthogonal basis, because these three basis vectors form an orthogonal set. 
Similarly, the triple of vectors below is an orthogonal basis for IR? since the 
vectors are orthogonal (as we saw above), there are three of them, and 
they are all non-zero: 


{(2, 1,1), (1, 24,2), (-2, 1,3). 


One reason that orthogonal bases are so important is that it is usually 
much easier to express a vector in terms of an orthogonal basis than in 
terms of a general basis. At the beginning of this subsection we expressed 
(10,0, 4) in terms of the orthogonal basis ((2, 1, 1), (1, —4, 2), (—2,1,3)} by 
writing 

(10,0,4) = a1 (2, 1,1) + o2(1, —4,2) + o3(—2,1,3) (3) 
and solving the resulting system of linear equations. 
However, there is a quicker way of solving equation (3) because the basis is 
an orthogonal basis. We take the scalar product of the vector (10, 0, 4) 
expressed as in equation (3) with each basis vector in turn, making use of 
the fact that the scalar product of orthogonal vectors is zero. 
First with (2, 1, 1): 

(2,1,1) - (10,0,4) = a1 (2,1,1) - (2,1, 1) + a2(2, 1,1) - (1, —4, 2) 

a a3 (2, 1; 1) 7 (73, 1, 3) 
= œ (2,1,1) (9:1, 1) +0 +0. 
The equation above gives 
(2,1,1)-(10,0,4) 24 
sAn l, 
(2,1,1): (2,1,1) 6 

Similarly, taking the scalar product with (1, —4, 2): 

(1, —4,2) - (10,0, 4) = 0 + a2(1, —4,2) - (1, —4,2) + 0. 


Thus 


(1,24,2)-(100,4 18 6 
a2 = ———————— _ Z _ — Z =, 
(1,4,2) - (1,—4,2) 21 7 
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Finally, taking the scalar product with (—2, 1,3): 
[59:55] 10:0,4) = 0 20 as(-9 1,3) 4 (01,3). 


Thus 
(—2,1,3) - (10,0, 4) 22-8 4 


“SDL a T 
Therefore, we have a, = 4, ag = - and a3 = —4, so 


(10,0, 4) = 4(2, 1, 1) + $(1,—4, 2) — 3(—2, 1,3). 


This procedure works for orthogonal bases in general in IR? and is 
summarised in the following strategy. 


Strategy C11 
To express a vector u in IR? in terms of an orthogonal basis 


ivi, V2, v3}: 

viet Vos u v3°U 
1. calculate ay = , Gp = and a3 = 

Wil? Wil IV OND Mg e 


2. write u = ayvy + Q2V2 + ova. 


Exercise C72 


(a) Verify that {(3, 4,0), (8, —6,0),(0,0,5)} is an orthogonal basis for IR?. 
(b) Express the vector (10,0,4) in terms of this basis. 


5.2 Orthogonal bases in R” 


In this subsection we see how the definitions and results of the previous 
subsection can be generalised to IR", for any positive integer n. We start 
with the definition of the scalar product of vectors. 


Definition 
Let v = (v1,v5,..., v4) and w = (wy, W2,..., Wn) be vectors in IR". 


The scalar product of v and w is the real number 


No Nr = DO RO XU ar oo op Walia. 


For example, in IR? the scalar product of the vectors v — (1,2,3,4,5) and 
w = (3, —4, 0,3, —2) is 
vew=1x3+2~x (-4)+3x04+4x3+5 x (2) 
=3-8+0+412-10=-3. 
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Exercise C73 


Calculate the following scalar products. 
(a) (1,2,—1,0) - (0, 25,6, —3) in R*. 
(b) (1,2,3,4,5,6) - (3,2, 1,0, —1, —2) in R$. 


We now see how the ideas of an orthogonal set and an orthogonal basis 
extend to R”. 


Definitions 
The vectors v and w in R” are orthogonal if v - w = 0. 


A set of vectors in R” is an orthogonal set if every pair of distinct 
vectors in the set is orthogonal. 


An orthogonal basis for IR" is an orthogonal set that is a basis 
for R". 


For example, in RÓ the set 
LOL TE T. 1), (2, -2,2, —2,2, -2), (5,5,0,0; -5, -5)] 
is an orthogonal set, since 
(1,1,1,1,1,1) - (2; -2,2, -2,2, -2) 
=2-—-24+2-2+4+2-2=0, 
(1,1,1,1,1,1) - (5,5,0,0, —5, —5) 
=5+5+0+0-—5—-5=0 


and 
(2, m 2, =2; 2, —2) : (5, 5, 0, 0, =9; —5) 
= 10 — 10 - 0 - 0 — 10 4- 10 — 0. 


Exercise C74 


Show that the set ((1,0, 0,0, 0), (0, 2,0,0,0), (0,0, 1, 1,0)? is an orthogonal 
set in R. 


Note that the standard basis 
{1,0,...,0), (0,1,0,...,0),..., (0,...,0,1)} 


is an orthogonal basis for R”. 
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In Subsection 5.1 you saw that any orthogonal set of three non-zero 
vectors in IR? is linearly independent and therefore forms an orthogonal 
basis for IR?. Exactly the same methods can be used to prove the following 
more general result. 


Theorem C32 


Let S = (vi, v2,..., Vk} be an orthogonal set of non-zero vectors in 
R”. Then S is a linearly independent set. 


Since any set of n linearly independent vectors in IR" forms a basis for IR", 
we obtain the following corollary to Theorem C32. 


Corollary C33 


Any orthogonal set of n non-zero vectors in R” is an orthogonal basis 
for IR^. 


Exercise C75 


Show that 
1, 2, 1, 0), (=1; l; =I, 1), (1, 0, =I, 0), (1, =, I 3) 


is an orthogonal basis for R4. 


Expressing vectors in terms of orthogonal bases 


Given an orthogonal basis for R”, it is particularly easy to express any 
given vector as a linear combination of the basis vectors. As for IR? in 

Subsection 5.1, we simply need to calculate scalar products: we do not 
need to solve a system of linear equations. 


Theorem C34 


Let (vi, v2,..., Vn} be an orthogonal basis for IR" and let u be any 
vector in R”. Then 


Vie A vVo*u Vn’ u 
u= vit vacteec M 
Wil e Wil Wp oD) Vm * Vn 


Proof Let (vi, vo,..., Vn} be an orthogonal basis for R” and let u be 
any vector in R”. Since u € R”, we can write u as a linear combination of 
the basis vectors v1, V2,..., Va: 


u = a1 V1 + QV +--+ d Qa Vp. (4) 
Forming the scalar product of both sides of equation (4) with vı gives 


vı +u = a (vı vı) (all other terms are 0), 


vı’ u 


so Q4 = i 
vie Vi 


Similarly, forming the scalar product of both sides of equation (4) with v2 
gives 
V2°U=Q2(Vv2°v2) (all other terms are 0), 


Vv’ u 


SO AQ = . 
V2 * V2 


Continuing in this way, we deduce that 


Vi*u 


a= for each i = 1,2,...,n. 
Vi i 
Thus 
V1*U V2*u Vn°Uu 
u= vı + yapn Vn, 
V1* vi V2 * V2 Vn * Vn 
as required. H 


The result of Theorem C34 can be expressed in the form of a strategy that 
generalises Strategy C11. 


Strategy C12 


To express a vector u in R” in terms of an orthogonal 


basis V1, V2,..., Vg: 
V1*U Vau Vn’ u 
1. calculate o4 — 6) = e An = E 
VIV IVioES VIO Vn * Vn 


2. write u = o4V1 + Q2V2 +--+ Om Vn. 


Exercise C76 


Express the vector (1,2,3,4) in terms of the orthogonal basis for R* 
{(1,2,1,0), (21,1, 21,1),(1,0, 21,0), (1, 21, ,3)]. 


(You showed that this basis is orthogonal in Exercise C75.) 
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Jørgen Pedersen Gram 
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5.3 Constructing orthogonal bases 
We now consider how to find an orthogonal basis. 


Suppose we want to find an orthogonal basis for R? containing the vector 
(2, 1,1). This means that we need to find two more vectors orthogonal to 
each other and orthogonal to the vector (2, 1,1). 


Now recall from Unit A1 that in R? a vector normal to a plane is 
perpendicular (orthogonal) to every vector in this plane. Thus to find such 
a pair of vectors, we can find two orthogonal vectors in the plane through 
the origin that has normal vector (2, 1, 1). 


Using the vector equation of a plane from Unit A1, the vector equation of 
a plane through the origin with normal vector n is 


x-n=0, 
so here we have (x, y, z) + (2,1,1) = 0; that is, the equation of the plane is 
2x T y-cz-0. 


Rather than pulling two orthogonal vectors vı and və in this plane out of 
a hat, we start with any pair of linearly independent vectors in this plane 
and follow a method known as the Gram-Schmidt orthogonalisation 
process to construct a pair of orthogonal vectors. 


In 1907, the German mathematician Erhard Schmidt (1876-1959) 
published an orthogonalisation algorithm, which became widely used. 
Schmidt acknowledged that his process was essentially the same as 
that published by the Danish mathematician Jørgen Pedersen Gram 
(1850-1916) in 1883. It appears that their names were first linked 
together in the 1930s. A related algorithm (now known as modified 
Gram-Schmidt) had been used much earlier by the French 
mathematician and scientist Pierre-Simon Laplace (1749-1827) in an 
attempt to estimate the masses of Jupiter and Saturn using the 
astronomical data of six planets. 


To find a pair of linearly independent vectors in the plane 2x + y+ z = 0, 
we need to find any two vectors in this plane that are not multiples of one 
another. We choose suitable vectors that are as simple as possible, for 
example, ones containing small numbers and zeros. We start by setting x 
to 1 and then setting z and y to 0 in turn, to get a pair of vectors. This 
gives 


wi-—(1,—2,0) and w»-(1,0,-2). 


Since these vectors are linearly independent, the set {w1, w2} forms a basis 
for this plane. (Any other pair of linearly independent vectors in the plane 
would do just as well.) 


We take the first vector v4 in our orthogonal basis to be the first of these 
vectors, so 


Vi = Wi = (1, —2,0). 


For the second vector v2 in our orthogonal basis, we start with w2 and 
then subtract from it a suitable multiple o of vı, chosen so that vı and v2 
are orthogonal, as illustrated in Figure 14. Since vg is a linear combination 
of vectors in the plane and the plane is a subspace, we know that və is also 
in the plane. 


So we set 
V2 = W2 — QV]; 
that is, 
vz = (1,0, —2) — a(1, —2, 0). 


We want to find the value of a so that vı and v2 are orthogonal. 
Therefore we must have 
Vi: V2 = V1* (W2 — avi) 


= V] * W2 — QV1 ° V1 


= 0. 
Hence 
Vi * W2 
Q = ——; 
Vie V1 


that is, in this case 
4-5 (72,0) + (1,0,-2) 1 
(1,—2,0): (1,—2,0) 5 
Thus 
v2 = (1,0, -2) — £(1, -2,0) = ($, 2, -2). 
So an orthogonal basis for the plane is (a, —2,0), (8. 2, -2) Iz 


Returning to the original problem, this means that we have found that an 
orthogonal basis for R? containing the vector (2, 1, 1) is 


((2,1,1), (1, 22,0), ($, 2, -2)]. 


The next exercise asks you to find an orthogonal basis for IR? containing a 
given vector by using the above method. 
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V9 = W2 — avi 
w2 = (1,0, -2) 


Figure 14 Subtracting a bit 
of vı from wə to get an 
orthogonal vector 
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Exercise C77 


(a) Find the equation of the plane through the origin with normal vector 
n — (3,—4,5). 

(b) Show that the vectors wı = (4, 3,0) and w» = (0,5, 4) lie in this plane. 

(c) Find an orthogonal basis (vi, v2) for the plane where vı = w1, and 


V1* Wo 
V9 = W2 — 


V1. 
V1* Vi 


(d) Hence write down an orthogonal basis for R? containing the vector 
(3, —4, 5). 


In these examples we started with a pair of arbitrary basis vectors for a 
plane and adjusted the second to obtain a pair of orthogonal basis vectors. 
'This method can be extended to higher-dimensional spaces by starting 
with an arbitrary basis and adjusting the basis vectors one by one to 
obtain an orthogonal basis. It is called the Gram-Schmidt 
orthogonalisation process. 


Theorem C35 Gram-Schmidt orthogonalisation process 


Let (wi, W2,...,Wn} be a basis for IR", and let 


Then (vi, vs,..., Vn} is an orthogonal basis for R”. 


Proof €. We show that each vector in the set (v1, v2,..., va] is 


orthogonal to every other vector in the set. .$ 


We note first that v2 is orthogonal to v1, since 


V1* W2 

Vi“ V2 —Vq1*1W2-—l|——— 1 
V1* Vi 

= (01 v2) - (228 


= (vi - w2) = (vi - W2) =0. 


5 Orthogonal bases 
Next we note that v3 is orthogonal to both vı and v», since 
V1*V3—V1* | W3— V= V2 
Vie Vi V2 * V2 


= (viwa) = (EE) ivo- (23) no 


V2 ° V2 


because vı and v2 are orthogonal. 


Similarly, 


u V1* W3 V2 ° W3 
V3 * V3 = V9“ W3 — m Vee ner v2 
1° VI 2° V2 


= (ow) - (299) o v = (33) (ve v) 


Vi*Wi V2* V2 


Continuing in this way, we deduce that each of the vectors v; is orthogonal 
to all the previous ones. It follows that v; v; = 0 for all 7, j with i Æ j, 
and hence that [vi,v2,..., v5] is an orthogonal basis for IR". L| 


Exercise C78 


Apply the Gram-Schmidt orthogonalisation process to the following basis 
for R°: 


{ (il; 0:0; 6; 0), (0,2,0,0, 0); (0, 0, 1,1,0), (1,1,1, 1,1), (1,0, —1, 0, 1)}. 


(You showed, in Exercise C74, that ((1,0,0,0,0), (0, 2,0,0,0), (0,0, 1, 1,0)! 
is an orthogonal set in R5.) 


5.4  Orthonormal bases 


Xy 


You have seen that using orthogonal basis vectors can be helpful. However, 
in many examples it is also useful to require one further condition — that 


the basis vectors are all unit vectors, as in the standard basis for R”. lv] = 13 


Recall, from Unit A1, that the magnitude of a vector v in R? or IR? is 


lv] 2 Vv - v. v = (5,—12) 


For example, if v = (5, —12), then |v| = 4/5? + (C12)? = 169 = 13, as Figure 15 The magnitude of 
illustrated in Figure 15. the vector (5, —12) 


We can similarly define the magnitude of a vector in R”, for any positive 
integer m. 
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Definition 
Let v = (v1, v2,..., Un) be a vector in R”. Then the magnitude of v 
is 


lV) 2 Vv -v = Jv? vier. 


Exercise C79 


Calculate the magnitude of each of the following vectors. 
(a) (3,—4,5) in R?. (b) (1,2, 21,0,3) in R?. 


Exercise C80 


Prove that if v is any non-zero vector in R”, then the vector 


MERDA 


has magnitude 1. 


We make the following important definition. 


Definition 
An orthonormal basis for R” is an orthogonal basis in which each 
basis vector has magnitude 1. 


An orthonormal basis is therefore comprised of orthogonal unit vectors. 


It follows from the result of Exercise C80 that, given an orthogonal basis 
for R", we can obtain an orthonormal basis by scalar multiplication: we 
need to multiply each basis vector by the reciprocal of its magnitude. This 
leads to the following strategy for constructing an orthonormal basis. 


Strategy C13 


To construct an orthonormal basis for IR" from an orthogonal basis 
Mig eee teris 


1. calculate the magnitude of each basis vector 


2. scalar multiply each basis vector by the reciprocal of its magnitude. 


v v 
The required orthonormal basis is o D TUE zm 
[va] [va MI 
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As a shorthand for 'scalar multiply a vector by the reciprocal of its 
magnitude', we may say 'divide a vector by its magnitude'. 


For example, we can use Strategy C13 to obtain an orthonormal basis 
for R? starting with the orthogonal basis {(2, 1, 1), (1, —4, 2), (—2,1,3)}, as 
follows. We calculate the magnitude of each basis vector: 

(2, 1,1)| = V22 +12 + 1? = V6, 

|(1, —4, 2)| = 1? + (—4)? T122— V 21, 

|(—2, 1,3)| = /(-22 + 2 + 8 = VTA. 
Dividing each orthogonal basis vector by its magnitude, we obtain the 
orthonormal basis 


Exercise C81 


Construct an orthonormal basis for IR^, starting with the basis 
{(1,2,1,0), (—1,1,—1, 1), (1,0, 1), (1, —1, 1, 3)}. 


(You showed, in Exercise C75, that this is an orthogonal basis for R4.) 


Note that some of our earlier results become much simpler if we use an 
orthonormal basis, rather than an orthogonal one. For example, 
Theorem C34 takes the following form because v; + v; = 1 for each i < n. 


Theorem C36 


Let (vi, v2,..., Vn} be an orthonormal basis for R”, and let u be any 
vector in R". Then 


u = (v1 - u)vi + (v2- u)vo - --- + (Vn * u)va. 


5.5 Other vector spaces 


We conclude this section by remarking that it is possible to define scalar 
products in vector spaces other than IR". For example, in the vector 
space P5 we can define the scalar product of two polynomials p, and po by 


1 
pi:po-— f nowe) dz. 


Such a scalar product is a real number and has properties that are very 
similar to those of the scalar product in R” — for example, pı * po = p2 * pı 
for any polynomials pı and pə. 
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We can then define such concepts as orthogonal polynomials, the magnitude 
of a polynomial, and the distance and angle between two polynomials. For 
example, the polynomials pı(x) = x and po(x) = z? are orthogonal, since 


1 
n:n-[ x- x° dr = [iz] =0 
-1 


and the magnitude of p» is given by 
1 
1 
[pa]? = P2 * p2 = E . r? dx = ltz] = A 


so |p2| = 2. 


Although such concepts may seem at first sight to make little sense 
intuitively, they have proved to be of great interest and importance, for 
example in mathematical physics. They also show that the mathematical 
structures we have introduced theoretically here can have surprising 
applications in other contexts. 


Summary 


In this unit you have seen how familiar properties of R? and IR? can be 
generalised to other, very different sets of vectors through the concept of a 
vector space. 


Your study of vector spaces has been driven by looking at properties of IR? 
and R, such as linear combinations, linear independence and spanning 
sets of vectors. You have seen how the familiar concept of axes and our 
intuitive idea of dimension relate to bases of these spaces. You have seen 
how these concepts generalise to IR" and other, very different vector spaces 
such as Pa, Mm n and C. You have met the Basis Theorem, which states 
that every basis for a given vector space has the same number of vectors, 
and that this number is the dimension of the vector space. 


Starting with subspaces of R? and IR? that can be visualised geometrically, 
you have seen that subspaces of vector spaces are subsets that are 
themselves vector spaces, in the same way that subgroups are subsets of 
groups that are themselves groups. 


Finally, you have seen how the scalar product and orthogonality of vectors 
in R” can be used to find orthogonal and orthonormal bases, which are 
particularly straightforward to work with. 


Vector spaces will underpin the remainder of the linear algebra units; in 
particular you will study functions between vector spaces in Unit C3 
Linear transformations and use orthonormal bases to classify conics and 
quadrics in Unit C4 Figenvectors. 


Learning outcomes 


Learning outcomes 


After working through this unit, you should be able to: 
e understand the definition of a real vector space 


e check whether or not a given set of elements forms a vector space under 
the operations of vector addition and scalar multiplication 


e explain the meaning of the terms linear combination, span and spanning 
set 


e form linear combinations of vectors in a given set 


e check whether a vector can be expressed as a linear combination of given 
vectors 


e find the set spanned by a given set of vectors 


e check whether a given set of vectors spans the vector space to which the 
vectors belong 


e explain the meaning of the terms linear independence, linear dependence, 
basis and dimension 


e test whether a given set of vectors is linearly independent 
e test whether a given set of vectors is a basis for a given vector space 


e find the E-coordinate representation of a vector given in standard 
coordinates, and vice versa 


e explain what is meant by a subspace of a vector space 

e test whether a given subset of a vector space is a subspace 
e find a basis for a subspace, and hence find its dimension 

e check whether the vectors in a given set are orthogonal 

e express a given vector in terms of an orthogonal basis 


e use the Gram-Schmidt orthogonalisation process to find orthogonal 
bases in R” 


e given an orthogonal basis, construct an orthonormal basis. 
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Solutions to exercises 


Solution to Exercise C44 Solution to Exercise C46 
u+ v = (1,—1,2,0, —3) + (0,2, —1,4,0) (a) (pi(z) + po()) + pa(a) 
= (L1,1,4, —3) = ((a4 + biz + c1?) + (a + box + cax?)) 
3u = —3(1, —1, 2,0, 3) + (aa + b3x + ca?) 
= (—3, 3, —6, 0, 9) = ((a, + az) + (bı + b3)z + (e + c2)z?) 
+ (a3 + baz + caa?) 


Solution to Exercise C45 nE E 


Let u = (u1, us, U3, U4), V = (v1, V2, V3, v4) and retatik 
w = (w1, W2, ws, W4). 
(a) (u+v)+w 
= ((u1, u2, ua, u4) + (v1, v2, U3, v4)) 
+ (w1, wo, wa, w4) 


= (u1 + t1, U2 + U2, U3 + V3, U4 + V4) 


and 
pi(x) + (p2(x) + p3(z)) 
= (a, + bz + C27) 
+ ((ag + box + cox?) + (a3 + b3x + cax?)) 
= (a, + biz + cz’) 
+ ((a2 + aa) + (b2 + b3)@ + (c2 + ca)a?) 
= (a1 + a2 + a3) + (bı + b2 + b3)x 
T (c1 + c2 + c3)z?. 
Therefore 
(p1(@) + po(x)) + pax) 
E ((v1, V2, V3, V4) + (w1, w2, ws, w4)) = p(x) + (po(x) + pa(z)), 
= (u1, u2, us, Ua) and so the associative property (A2) holds for 
+ (v1 + w1, v2 + We, v3 + ws, V4 + w4) addition in P3. 
= (u1 + vi + w1, U2 + v2 + Wa, Us + V3 + Ws, (b) We have 0 = 0 + Oz + 0z?, so 
ua + v4 + w4). 
Therefore (u + v) + w = u + (v + w), and so the 
associative property (A2) holds. 
(b) v+ (=v) 
= (v1, V2, V3, V4) + (—V1, —V2, —V3, —V4) 


= (v1 — v1, V2 — V2, U3 — V3, V4 — V4) 


+ (w1, We, w3, w4) 
= (uy + v1 + w1, U2 + V2 + We, ug + Us + 3, 
ua + v4 + wa), 
u+(v+w) 


= (u1, u2, U3, Ud) 


p(x) +0 = (a, + ba + ei?) + (0+ Ox + 022) 
= (a4 +0) + (by + 0)z + (e1 + 0)z? 
= a + bız + cz? = pı (z) 


Also, using the commutative property (A5) 
(proved in Worked Exercise C23(a)) we have 


— (0,0,0,0) 2 0 pi(z) +0 = pi(z) = 0 + pi(z), 
Also, using the commutative property (A5) so the additive identity property (A3) holds for 
(proved in Worked Exercise C22(a)) we have addition in P3. 


v+(-v) =0=-v4v, : : 
Solution to Exercise C47 
so the additive inverses property (A4) holds. 
(a) 1x p(z) 21x (1— z + 227) 
=1x1—1xg+1x 22? 
=1-2£+4 227 = p(x), 


and therefore the identity property (S3) holds here. 
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(b) a(Sp(x)) = 2(-3(1— z + 2z?)) 

= 2(-3 + 3x — 62?) 
—6 + 6x — 12z? 

= —6(1 — x + 22?) = (oB)p(a), 
and therefore the associative property (S2) holds 
here. 


Solution to Exercise C48 


(a) Consider (1,3) and (2,5), both in V. Then 
(1,3) + (2,5) = (3,8), which does not belong to the 
set V, since 2x 34-1 = 7 Z 8. So the set is not 
closed under vector addition. 


Therefore the set of all ordered pairs (x,y) with 
y = 2x + 1 fails to satisfy the closure axiom (A1), 
so is not a real vector space. 


Alternatively, note that for (0,0) € R? we have 
2x0+1=1#0, so the zero vector is not in V 
and the additive identity axiom (A3) fails. 


Other axioms also fail or do not make sense. 


(b) Consider the matrix A — (3 5) and 


a= i. Then aA = 7 ;j which does not 


1 
9^ "9 
belong to the set. 


Therefore the set of matrices of the form 


[D c) with a,b,c € Z 
b c 


fails to satisfy the closure axiom (S1), so is not a 
real vector space. 


Note that axioms A1—A5 and S3 do all hold here, 
but since axiom S1 fails, the axioms $2, D1 and D2 
are meaningless. 


Solution to Exercise C49 


(a) 4vı — 2v2 = 4(0,3) — 2(2,1) 
= (0,12) — (4,2) = (—4,10) 
(b) 3v; + 2v2 = 3(1,2,1,3) + 2(2, 1,0, —1) 
= (3,6,3,9) + (4,2,0, —2) 


c (7, 8, 3, 7) 


Solution to Exercise C50 


(a) 2v1 — 4v2 = 2(2— xz + 327) — 4(—1 + x) 
= (4 — 2x + 6x7) — (—4 + 4x) 
— 8— 6x + 62? 


Solutions to exercises 


(b) 2v; — 4v» = 2sin z — 4rcosx 


(c) 2v1 — 4v2 = 2 E o) —4 ( 2 
(3 o) Co =s) 
-(: 3) 


Solution to Exercise C51 
We apply Strategy C6. 
(a) Let o and f be real numbers such that 


(2,4) = (0,3) + £2, 1) = (28,30 + 8). 
Equating corresponding coordinates, we obtain the 
system 

28 =2 
38a+ B=4. 


The first equation gives 6 = 1, and substituting 
this into the second equation gives a = 1, so 


(2, 4) = (0,3) + (2, 1). 


(You might have spotted this linear combination 
without performing the calculations — it is always 
worth checking there is not an obvious solution 
before diving into a strategy!) 


(b) Let a, 8 and y be real numbers such that 
(2,3,—2) = a(0, 1,0) + (1,2, 1) + (1,1, —2) 


Equating corresponding coordinates, we obtain the 
system 


+ y=2 
a+ 28+ y=3 
=f = y= —2. 


Adding the first and third equations gives y = 0, 
and substituting this into the first equation gives 
B = 2. Substituting both these values into the 
second equation gives œ = —1, so 


(2,3, —2) = —(0,1,0) + 2(1,2, —1) + 0(1, 1, —2). 
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(c) Let o and 8 be real numbers such that 
3 1 1 -1 0 —-2 
G a)=e(o Jo 1) 

fa 
"AU 

Equating corresponding entries, we obtain the 

system 


a =3 
—a — 2ß =1 
2a+ B=4. 
The first equation gives a = 3, and substituting 
this into the second equation gives 3 = —2. These 


values also satisfy the third equation, so 


(0 4) =3(0 “2)-2(0 1) 


Solution to Exercise C52 
(a) We write 
(1,5, 4) = avı + Bva 
= a(1,0,3) + B(0, 2,0) = (a, 26, 3a). 
Equating corresponding coordinates, we obtain the 
system 


a =] 
28 —5 
3a — 4. 


This system is inconsistent and therefore has no 
solution. So (1,5, 4) does not lie in the subset of 
IR? spanned by (vi, v2}; that is, (1,5, 4) does not 
belong to ({v1, v2}). 
(b) We write 
(1,5,4) = avı + Bv» + v3 

= a(1,0,3) + 8(0, 2,0) + y(0,3, 1) 

= (a, 26+ 37,3a+7). 
Equating corresponding coordinates, we obtain the 
system 


a =] 
26 + 3y 25 
3a + y=4. 


The first equation gives œ = 1, and substituting 
this into the third gives y = 1. Substituting this 
into the second equation gives 8 = 1, so (1,5, 4) 
lies in the subset of R? spanned by (vi, v2, v3}; 
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that is, (1,5,4) belongs to ((vi, v2, v3]) and it can 
be written as 


(1,5,4) = 1(1,0,3) + 1(0, 2,0) + 1(0, 3, 1). 


(You might have spotted this and avoided 
following the formal method.) 


Solution to Exercise C53 
(a) Each vector in R? can be written as (x,y). To 
show that (x,y) is in ({(1,1), (—1,2)}), we write 

(x, y) = ali. 1) F pi, 2) 

= (a — B,a + 28). 

Equating corresponding coordinates, we obtain the 
system 

a- =r 

a 4 26 =y. 
These equations have solution a = $(2a + y) and 


B= i(y — x), so any vector in R? can be written in 


terms of (1,1) and (—1,2) as 
I(2x + y)(1,1) + i(y — z)(- 1,2). 


), (—1,2)) is a spanning set for R?. 


(x,y) = 
So {(1,1 


(b) Each vector in R? can be written as (x,y). To 
show that (x,y) is in (((2, —1), (3,2)}), we write 


(x,y) = o(2, —1) + (3,2) 
= (2a + 38, —a + 28). 
Equating corresponding coordinates, we obtain the 
system 


2a 4-30 =2 
—a 4- 28 =y. 


These equations have solution a = (2x — 3y) and 
B= 4 (a + 2y), so any vector in RÊ can be written 
in terms of (2,—1) and (3,2) as 


(x,y) = ?(2z — 3y) 2, 1)  $(z + 2y)(3, 2). 
So ((2, —1), (3, 2)} is a spanning set for R?. 


Solution to Exercise C54 
We write 
(x,y,z) = a(1,0,0) + 8(1,1,0) + (2,0, 1) 
= (a+ B+ 27, B, Y). 


Equating corresponding coordinates, we obtain the 
system 


a+B+2y=2 
B =y 
"e. 


Working backwards from the third equation, we 
find that these equations have solution y = z, 
B = y and a = z — y — 22, so any vector in IR? can 
be written in terms of (1,0,0), (1, 1,0) and (2,0, 1) 
as 

(x,y,z) = (x — y — 22)(1,0,0) 

T 10) + 2(2,0,1). 

So ((1,0,0), (1, 1,0), (2, 0, 1)? is a spanning set 
for R?. 


Solution to Exercise C55 


Each polynomial in P4 can be written as 
a. -- bx -- cx? + da?. To show that a+ bx + cx? + dx? 
belongs to ((1-4- z,1-- z?,1 4- z2, z]), we write 
a + bx + cx? + da? 
— o(14- x) -- 8(1 4- 32) 4- 4(1 4- 23) + óx 
=(a+ B y) + (oi 6)x + Ba? c ya. 
Equating corresponding coefficients, we obtain the 
system 


a+B+y¥ Eu 
a +d=b 
B = 

y =d. 


It has solution y = d, f a —c— d and 
ó —b—a- c4 d. So 
a 4- bx: 4- cx? + da? 

= (a —c— d)(14 x)J 

c (b — a-Fc- d)a. 

Thus ({1+2,1+2°7,1+2°,2}) = P4. 


€, a 


Solution to Exercise C56 
(a) We have 
(S) = (0(1,0,0): a € R} 
= ((0,0,0) : a € R}. 
(Geometrically, (S) is the z-axis.) 


Solutions to exercises 


(b) We have 
i - la(s 3) +8(-5 9) seer} 


x]f2m-g 0 . 
- (Pro ptas) aser} 
Thus 


t ct ;) aber}. 


To show that every 2 x 2 diagonal matrix belongs 
to (S), we write 


a 0| (2a—8 0 
0 bj | 0 3a 4-28] 
Equating corresponding entries, we obtain the 
system 
20 — B=a 
3a + 26 = b. 


It has solution 


SO 


Solution to Exercise C57 


(a) These two vectors are linearly independent 
because neither is a multiple of the other. (In this 
case there is no need to use Strategy C7.) 


(b) Using Strategy C7, we write 
o(1, —1) + 8(1, 1) + 7(2, 1) = (0,0). 
This gives the system 
a+p+2y= 0 
—a-FB-r y=0. 
Adding the equations gives 28 + 3y = 0, or 


p= —3y, and substituting this into the first 


equation gives a = -i* that is, y = —2a and 
B = 3a. The solution set of the system is 


a=k, p= 3k, y= —2k, keR, 
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so there are infinitely many solutions. For 
example, k — 1 gives 


(1, 1) + 3(1, 1)  2(2,1) = (0,0). 
So the set ((1, —1), (1, 1), (2, 1)) is linearly 
dependent. 


Alternatively, you may have expressed the solution 
set here in terms of y and found another solution — 
any solution (where a, 3 and y are not all zero) is 
sufficient to show that the vectors are linearly 
dependent. 


(c) These two vectors are linearly independent 
because neither is a multiple of the other. (In this 
case there is no need to use Strategy C7.) 


(d) We write 
a(1,0,0) + 8(1,1,0) + (1,1, 1) = (0,0,0). 


This gives the system 


a+8+7=0 
B+ry=0 
"y = 0. 


The third equation gives y = 0, and substituting 
into the second equation gives 6 = 0. Finally, 
substituting into the first equation gives a = 0. 
The only solution is œ = 8 = y = 0. 

Therefore the set ((1,0,0), (1, 1,0), (1, 1, 1)] is 
linearly independent. 

(e) These two vectors are linearly independent 
because neither is a multiple of the other. (Again, 
there is no need to use Strategy C7.) 


Solution to Exercise C58 


(a) The set (1,2,27,292,1 +£ +r? -- 2°} is 
linearly dependent because the fifth vector is the 
sum of the first four vectors. So 


ited +r’ -—(-a-dqbz fo) =o. 
(b) The set S is linearly independent because 
neither matrix is a multiple of the other. 
(c) We apply Strategy C7. 
We write 


elo i) +e Ark g-G y 
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which can be written as 


wig a 4 »y 2G o) 
B+y a+8+y) N0 0/7 


Equating corresponding entries, we obtain the 
system 


a+B+y7y=0 
a Ty-0 

puru 
ap py um D. 


Subtracting the second equation from the first, and 
the third from the fourth, we get 6 = 0 and a= 0. 
Substituting these values in the first and fourth 
gives y = 0 also. Therefore the only solution to 
this system is a = B = y = 0. Therefore the set S 
is a linearly independent subset of M» 5. 

(d) The set (1-4- i, 1 — i} is linearly independent 
because neither vector is a (real) multiple of the 
other. 


Solution to Exercise C59 


(a) None of the vectors in this set has a non-zero 
x-component; so whenever x # 0, we cannot write 
(x,y,z) in terms of these three vectors. 


Therefore this set of vectors is not a basis for IR? 
because it does not span R?. 


(If you had not spotted the zero z-component and 
had followed Strategy C8, you would have 
discovered that this set is not linearly independent: 
for example, 


16(0, 1,2) — 11(0, 2,3) + (0, 6, D) = (0,0, 0). 
Therefore this set of vectors is not a basis for R3.) 
(b) We check both conditions in Strategy C8. 
Using Strategy C7, we write 

a(1, 2,1) + 8(1,0, —1) + 4(0,3, 1) = (0,0,0), 
which simplifies to 


(a+ 8,2a + 3y,a 


By) = (0, 0, 0). 


Equating corresponding coordinates, we obtain the 
system 


ah B =0 
2a + 37 =0 
a—Bt+ y=0. 


Adding the third equation to the first gives 

2a + y = 0, and subtracting this from the second 
equation gives y = 0. Substituting this into the 
second equation gives a = 0. Finally, substituting 
a = 0 into the first equation gives 8 = 0. The only 
solution is a = f = y — 0. 


Therefore the set is linearly independent. 
We apply Strategy C6. 


Each vector in IR? can be written as (x, y, z), with 
x,y,z € R. To show that (x,y,z) is in 


aG, 2, 1), (1, 0, m (0, 3, 1)}), 
we write 
(x,y,z) = a(1, 2,1) + 8(1,0, —1) + (0,3, 1). 


Equating corresponding coordinates, we obtain the 
system 


a 4 B e 
2a + 3y=y 
a-B+ y=z. 


Adding the third equation to the first gives 

2a +y = x + z, and subtracting this from the 
second equation gives y = 4(y — x — 2). 
Substituting this into the second equation gives 
a= 7 (3a —y+3z). Finally, substituting for o in 
the first equation gives 8 = F(a +y—3z). We have 
a solution, so any vector in R? can be written as 


(x,y,z) = (32 — y + 32)(,2,1) 
+ q(x y — 32)(1,0,-1) 
+5(y—a = 2)(0,; 1). 
Therefore the set of vectors spans R3. 
Thus {(1, 2,1), (1,0, —1), (0,3, 1)} is a basis for R. 
(c) Here we have 
(1,1,1) = (1,0,0) + (0, 1,0) + (0,0, 1), 
so these vectors are not linearly independent. 


Therefore the set 
{(1, 0, 0), (0, l; 0), (0, 0, 1), (L IE 1) 


is not a basis for R?. 


Solution to Exercise C60 
We check both conditions in Strategy C8. 


Solutions to exercises 


'This set is linearly independent because there are 
only two vectors in the set, and neither vector is a 
multiple of the other. 


We apply Strategy C6. 


Each vector in R^ can be written as (x, y, z, w), 
with z, y, z,w € R. To show that (z,y, z, w) is in 


(((1, 2, =i, =I); (=1; 5, 1, 3)}), 
we write 
(x, Y, Z, w) = a(1, 2, =k; -1) Ts B=, 5, i 3). 


Equating corresponding coordinates, we obtain the 
system 


a- p=r 


2a +58 =y 
—a + B-z 
—a + 38 = w. 


Adding the first and third equations gives 
xz +z = 0. This contradicts the assumption that z, 
y, z and w can take any real values, so 


{(1,2,—1,—1), (—1,5,1,3)} 
is not a spanning set for R4. 


Thus the set ((1,2, —1, 21), (—1,5,1,3)} is not a 
basis for R£. 


Solution to Exercise C61 
We check both conditions in Strategy C8. 
Using Strategy C7 we write 


ali o) AG otako 1) +40 a) 
= (o 0) 


which simplifies to 


a+2y—-3ô =P’) JU 0 
a+ B y A0 07^ 
Equating corresponding entries, we obtain the 
system 


189 


Unit C2 Vector spaces 


From the fourth equation we have y = 0, and from 
the second and third œa = —6 = —ó. Substituting 
into the first equation gives a+ 3a = 0, so a= 0. 
The only solution is therefore à = B = y = ô = 0. 


Therefore the set is linearly independent. 

We apply Strategy C6. 

Each 2 x 2 matrix can be written as (: 2) with 
a,b, c, d € R. To show this is in (S) we write 


a b 1 0 0 —1 
(a=k o) tG o) 
2 0 -3 1 
e 1) +8( 0 3! 
Equating corresponding entries, we obtain the 
system 


Qa + 27 — 36 =a 
—B + d6=b 
a+ B =C 
y =d; 


From the fourth equation we have y = d, and 
adding the second equation to the third gives 

a +ô = b 4- c. Substituting for y in the first 
equation gives œ — 3ó = a — 2d. These last two 
equations give 6 = i(b +c—a+2d). 

Then, by substitution, a = I(a + 3b + 3c — 2d) and 
B= i(-a— 3b + c + 24). 

We have a solution a = (a + 3b + 3c — 2d), 

B = i(—a — 3b + c + 2d), y = d and 

ó — i(b--c— a 24). 

Therefore the set of matrices S spans the set M29 
of all 2 x 2 matrices. 


Thus S is a basis for M». 


Solution to Exercise C62 


(a) For the basis E = ((1,2), (—3,1)}, we have 
(2152590. 9136-3. 1) 
= (2,4) + (23,1) 
= (-1,5). 
(b) For the basis 
E = {(1,0, 2), (C1, 1,3), (2, -2,0)}, we have 
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(1,1,—1)g = 101, 0,2) + 1(—1, 1,3) = 1(2, —2,0) 
= (1,0,2) + (—1, 1,3) — (2, —2,0) 
= (—2, 3,5). 


Solution to Exercise C63 
(a) We write 
(5, —4) = a(1, 2) + B(—9, 1). 
Equating corresponding coordinates, we obtain the 
system 
a—380-5 
2a+ B=-A4. 
Solving these equations gives a = —1, 8 = —2, so 
(5, —4) = —=1(1, 2) = 2(—3, 1) 
= (=1, —2)z. 
(b) We write 
(—3,5, 7) = a(1,0, 2) + 8(—1,1,3) + y(2, —2,0). 
Equating corresponding coordinates, we obtain the 
system 
a- B+2y7=-3 
8—2y25 
2a 4- 38 zu 


Adding the first and second equations gives o — 2, 
and substituting this into the third equation gives 
B = 1. Substituting for @ in the second equation 
gives y — —2. So 


(—3,5,7) = 2(1,0,2) + 1(—1, 1,3) — 20, —2, 0) 
= (2,1, —2)g. 


Solution to Exercise C64 
We apply Strategy C9. 


(a) This set contains only two vectors, not three, 
so cannot be a basis for IR?. 


(Neither vector is a multiple of the other, so it is 
however linearly independent.) 


(b) This set contains three vectors, so it may be a 
basis for R?. 


We write 


o(1, 0, 1) T B(1, 0, —1) + 7(0, 1, 1) = (0,0, 0). 


Equating corresponding coordinates, we obtain the 
system 


a B =0 
y=0 
ü 4 yc. 


The second equation gives y = 0. Substituting this 
into the third equation gives a — 6 = 0. Adding 
this new equation to the first equation gives a = 0 
and hence 6 = 0. The only solution is 
a=B=7=0. 

Therefore the set is linearly independent. 


The set contains three vectors and is linearly 
independent; therefore it is a basis for R?. 


(c) Here we have 

(1, —1,0) + (2,1, 4) = (8,0, 4), 
so this set is not linearly independent. 
Therefore this set is not a basis for R. 


(It does however contain the correct number of 
vectors. ) 


(d) This set contains four vectors, so it cannot be 
a basis for R3. 


(Alternatively, here we have 
(1,1, 1) = (1,0,0) + (0, 1,0) + (0,0, 1), 


so this set is also linearly dependent.) 


Solution to Exercise C65 
We apply Strategy C9. 


(a) This set contains four vectors and M2. has 
dimension 4, so it may be a basis. 


Using Strategy C7 we write 
1 0 0 1 1 1 0 1 
(or ye yt 1) 
(0 0 
~ \0 0 


which simplifies to 


grey Paes}. £0 0 
até B+ô ~ \O 0)’ 


Solutions to exercises 


Equating corresponding entries, we obtain the 
system 


a +y =0 
py qoc 
a +ô=0 

B +ô=0. 


From the first, third and fourth equations we have 
a = B = —y = —ô. Substituting in the second 
gives — 8 = 0. The only solution is therefore 
Therefore the set is linearly independent. 

The set S contains four vectors and is linearly 
independent so is a basis for M» 9. 

(Compare the length of this solution to that of 
Exercise C61 using Strategy C8.) 

(b) This set contains two vectors and P» has 


dimension 2, so it may be a basis. 


This set is linearly independent because there are 
only two vectors in the set, and neither vector is a 
multiple of the other. 


So by Strategy C9, the set is a basis for P5. 


Solution to Exercise C66 


The set S is a subset of IR?, so we use Strategy C10. 
If x = 0, then (x, —2x) = (0,0), so S contains the 
zero vector of R?. 
Let vı = (z1, —221) and v2 = (x2, —2x2) belong 
to S. Then 
V4 + V2 = (#1, —221) + (x2, —222) 
= (41 + T2, —22%1 — 273) 
= (21 + Zo, —2(21 + 22)). 
This vector has the correct form for a vector in S, 
since 71 + z9 € R, so S is closed under vector 
addition. 
Let v = (z, —2r) € S and a € R. Then 
av = o(z, —2z) 
= (ax, a(—2z)) 
= (az, —2(az)). 
This vector has the correct form for a vector in S, 


since ax € R, so S is closed under scalar 
multiplication. 
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Since conditions (1), (2) and (3) are satisfied, S is 
a subspace of R2. 


(This subspace is the line through the origin with 
equation y — —2z.) 


Solution to Exercise C67 


In each case the set S is a subset of V, so we use 
Strategy C10. 
(a) If 0 € S, then (x, z + 2) = (0,0) for some 
number r. Equating coordinates, we obtain the 
system 

xr=0 

T= =l, 
This system is inconsistent so has no solution. 


Therefore 0 does not belong to S and condition (1) 
is not satisfied. Hence S is not a subspace of R?. 


(b) If x = y = z = 0, then 
(x,y, 2,2 + 2y — z) = (0,0,0,0), 
so S contains the zero vector of R^. 
Let vı = (z1,y1, 21,21 + 2y1 — 21) and 
V2 = (£2, Y2, 22, T2 + 2y2 — z2) belong to S. Then 
vid V2 = (x1, Y1, 21,21 + 2y1 — 21) 
+ (22, Y2, 22, 22 + 2y2 — 22) 
= (£1 + £2, y1 + Y2, 21 + 22, 
£1 + 2y1 — 21 + 22 + 2y2 — 22) 
= (£1 + £2, Y1 + Y2, 21 + 22, 
(x1 + 22) + 2(y1 + yo) — (21 + 22)). 
This vector has the correct form for a vector in S, 


since z4 + zo, Y1 + yo, 21 + zo € R, so S is closed 
under vector addition. 


Let v = (a, y,2z,0 + 2y — z) E€ S and a € R. Then 
av — a(z,y, z, z + 2y — z) 
= (ax, ay, oz, a(x + 2y — z)) 
= (az, ay, az, (ax) + 2(ay) — (az)). 
This vector has the correct form for a vector in S, 


since ax, oy, oz € IR, so S is closed under scalar 
multiplication. 


Since conditions (1), (2) and (3) are satisfied, S is 
a subspace of R4. 
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Solution to Exercise C68 


In each case the set S is a subset of V, so we use 
Strategy C10. 


(a) The zero vector of P3 is 0 + Ox + 0x? = 0. If 
a =b = 0, then p(x) = 0+ 0x = 0, so S contains 
the zero vector. 


Let pi (x) = a4 + bız and po(x) = a3 + box belong 
to S. Then 
pi(x) + po(x) = a1 + biz + a2 + box 
= (a1 + a2) + (bi + ba) a. 
This polynomial has the correct form for a vector 
in S, since a, + a2, b; + b2 € R, so S is closed under 
vector addition. 


Let p(x) — a -- bx € S and o € R. Then 
ap(x) = oa + abz = (aa) + (ob)a. 


This polynomial has the correct form for a vector 
in S, since oa, ob € R, so S is closed under scalar 
multiplication. 


Since conditions (1), (2) and (3) are satisfied, S is 
a subspace of V. 


(b) The zero vector of Ps is 0 + 0x + Ox? = 0, 
which is not of the form x + ax? for a vector in S. 
Therefore 0 does not belong to S and condition (1) 
fails. Hence S is not a subspace of P3. 


(Alternatively, you may have spotted that 
conditions (2) and (3) also fail. Using a 
particularly simple vector can make the 
calculations to show this easy: by setting for 
example a = 0, we see that p(x) = x belongs to S. 
The sum p(x) + p(x) = 22, however, does not 
belong to S, and for a € R not equal to 1, the 
scalar product az is also not in S.) 


(c) The zero vector of M29 is 0 = t b which 


is not of the form for a vector in S. 


a 1 
0 d 
Therefore 0 does not belong to S and condition (1) 
fails. Hence S is not a subspace of M29. 


Solution to Exercise C69 


Since ((1, —2, 0), (0,3, 3)) is a linearly independent 
set, the subspace it spans is a two-dimensional 
subspace of IR? and is therefore a plane through the 
origin with equation 


ax + by + cz = 0, 
where a, b, c are not all zero. 


Since the vectors in the spanning set lie in the 
plane, the values of a, b and c must satisfy the 
system 

a — 2b =0 

3b + 3c = 0. 

The first of these equations gives a = 2b, and the 
second equation gives c = —b, so the subspace is 
the plane with equation 2ba + by — bz = 0, or, 
equivalently, 


2e+y—-—z=0. 


Solution to Exercise C70 
Since 
(x,y, 2, + 2y — z) 
= (2,0,0, x) + (0, y, 0, 2y) + (0,0, z, —z) 
= 2(1,0,0, 1) + y(0, 1,0, 2) + 2(0,0, 1, —1), 
any vector in S can be written as a linear 
combination of the vectors in the set 


141, 0, 0, 1); (0, i» 0, 2), (0, 0, 1, =1)}; 
so this set spans S. 


To check whether these vectors are linearly 
independent, we write 
a(1,0,0,1) + 8(0,1,0,2) + (0,0, 1, — 1) 
= (0,0,0,0). 
This gives the system 


a =0 
B =0 
y=0 
a+28—-7y=0, 


and hence a = 6 = y = 0. Therefore the set is 
linearly independent. 

So ((1,0,0, 1), (0, 1,0, 2), (0,0, 1, —1)) is a basis 
for S. Therefore S has dimension 3. 


Solutions to exercises 


Solution to Exercise C71 
(a) (2,1,1): (12,242) 22x 1+1 x (2 1x2 
=2—442=0, 
so (2, 1, 1) and (1, —4,2) are orthogonal. 
(b) vi-vg =-2x9+6x2+1x6=0, 
so vı and v» are orthogonal. 
vi*Vg = 2x 446 x (215) +1 x (-1) 
— —99, 
which is non-zero, so vı and v3 are not orthogonal. 
V9*V3 =9 x 4+2 x (—15) 
-6x(-1)20, 
so v2 and v3 are orthogonal. 


Solution to Exercise C72 

(a) Let vı = (3,4,0), vo = (8, —6,0) and 

v3 — (0,0,5). Then 
V1:V2—38x8-c4x(-6)--0x020, 
viev3=3x04+4x04+0x5=0, 
vo-v3 =8x0+(-6)x0+0x5=0. 

Thus (vi, v2, v3} is an orthogonal set in IR?. Since 


there are three non-zero vectors in this set, it is an 
orthogonal basis for R?. 

(b) We apply Strategy C11. 

V1*uU 

Qa, = ——— 

vr Vi 

(3,4,0) - (10,0, 4) 
(3, 4, 0) - (3, 4, 0) 
30 6 


(8, =0; 0) ° (10, 0, 4) 
(8, =; 0) Š (8, =6; 0) 
80 4 


100 5 
and 
v3°U 


V3 * V3 
(0,0, 5) - (10,0, 4) 
~ (0,0,5) - (0,0,5) 
20 4 
=== 
Thus (10,0, 4) = 2(3,4,0) + 2(8, —6,0) + 2(0,0,5). 
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Unit C2 Vector spaces 


Solution to Exercise C73 Therefore these vectors form an orthogonal set 
in R4. Since there are four, non-zero vectors in this 
(a) (1; 2, =l, 0) . (0, zu 6, —3) 


set, these vectors form an orthogonal basis for IR 
—1x0-2x( 5) + ( 1)x6+0x ( 3) by Corollary C33. 


—0—10—-640 
Te Solution to Exercise C76 
(b) (1, 2,3,4, 5, 6) . (3,2, 1,0, =1, —2) We apply Strategy C12. 
=1x3:4+2x24+3x14+4x0 
+5*x (—1) 6x (—2) Let VAS (1,2, 1,0), be =LI =L; 1); 
=3+4+3+0-5-— 12 V3 = (1,0,—1,0), VA = (1,—1,1,3) and 
-7 u = (1,2,3,4). Then 
V1*U 4 
: : Q1 = = Ll =, 
Solution to Exercise C74 vivi 6 3 
We check that each pair of vectors is orthogonal by as = vou n 2 = 1 
forming the scalar product of each pair of vectors Vg^*wo 4 2 
in the set: Oo vyu -2 | , 
(1,0,0,0,0) - (0,2,0,0,0) 20--0--04-04-0 w^ any ^ ^ 
= 0, | v4-u 4 7 
(1,0,0,0,0) - (0,0,1,1,0) =0+0+0+0+0 04 View dà 6 
US Thus 
(0, 2,0,0,0) - (0,0,1,1,0) =0+0+0+4+0+0 (1,2, 3,4) = $(1,2, 1,0) + 2(-1,1, 1,1) 
=). (1,0,—1,0) + £(1, 21, 1,3). 
Therefore these three vectors form an orthogonal : . 
in R5 Solution to Exercise C77 
set in R°. 
! : (a) Using x: n = 0, we have 
Solution to Exercise C75 
(x,y, 2) * (3, 4,5) = 0; 
We check that each pair of vectors is orthogonal by 
forming the scalar product of each pair of vectors that is, the equation of the plane is 
in the set: 3r —4y+5z=0. 
(1,2, 1,0) -(—1,1,-1,1) =-1+2-—1+0 
sü (b) We have 
(,2,1,0] «05,0, 21,0] &13-0— 14-0 Wishes ton Oe) 
a =12—12+0=0, 
(1,2,1,0) < (1,—1,1,3)=1-2+1+0 a5 


w2» n = (0,5, 4) + (3, —4,5) 
— 0 — 20 4- 20 = 0, 


so both these vectors lie in the plane. 


=0, 
(—1,1,—1,1)- (1,0,—1,0) =—1+0+1+0 


(o Los Todi e= (Alternatively, rather than using the vector 
equation of the plane, we can check that the points 
? (4,3,0) and (0,5,4) satisfy the equation 
(1,0, 71,0) - (1, —1,1,3)=1+0—-1+0 3x — 4y + 5z = 0 of the plane.) 
= 0. 
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Solutions to exercises 


(c) We set vı = (4,3,0) and Thus we have the orthogonal basis 
Vo = Wa Myj ((1,0,0, 0, 0), (0, 2, 0, 0, 0), (0, 0, 1, 1,0), 
MEME (0,0,0,0,1), (0,0, — 1, 1,0) V. 
— (0,5,4) — 43:0) (05,4), 5 4) 
(4, 3, 0) - (4, 3, 0) Solution to Exercise C79 
= (0,5, 4) — 35 (4,3,0) (a) (3,—4,5) - (3, 4,5) =9 + 16 +25 
= (0,5,4) — 3(4,3,0) = 50, 
= (-12, 18 4), so |(3, —4, 5)| = v50 = 52. 
The required orthogonal basis for the plane is (b) (1,2,—1,0,3) - (1,2,—1,0,3) 
{(4,3,0), (—22, 19, 4)}. =14+4+1+0+9 


= 15, 


. 3 . 
(d) An orthogonal basis for IR? is so |(1,2, —1,0,3)| = /15. 


((3, —4,5), (4,3,0), (C 2, #,4)}. 


Solution to Exercise C78 


Solution to Exercise C80 


If v = (v1, v2,..., Un) is a non-zero vector, then 
We apply Theorem C35 with wı = (1,0, 0,0, 0), " b» p " 
n 
wə = (0,2,0,0,0), w3 = (0,0, 1, 1,0), ivi = (a SS) , 


wa = (Ll, 1,1, 1, 1) and ws = (1,0, —1,0, 1). 
Since w1, w2 and w3 already form an orthogonal so the magnitude of v/|v| is 
set, we have 

vı = wy = (1,0,0,0,0), 

v2 = w2 = (0, 2,0,0,0), 

v3 = w3 = (0,0,1,1,0). 


Then 
(= — (= za) 
v4 = W4 — vı — 
Viev V2° V s š 
hc dido Solution to Exercise C81 
= (zm) V3 We apply Strategy C13. 
V3° V3 
We have 
= (1,1,1,1,1) — 1(1,0,0,0,0) I(1, 2, 1,0)| = V6, 
2 2 
_ 4(0, 2, 0, 0, 0) uH 5(0, 0, 1, 1,0) \(—1, 1,—1, 1)| — VA SEA 
= (0,0,0,0,1) |(1,0, —1,0)| = V2, 
a v w v w (1, —1,1,3)| TM 12 = 23. 
1' W5 2* W5 
V5 = W5 ( ) vi ( ) v2 The required orthonormal basis for R^ is therefore 
Vievi V2 * V2 
1 1 1 
" — (1,2,1,0), cT qe D de 
7 (= w) v- (= =) y, ig ) zi ) vs 
V3 * V3 VA * V4 1 (1 -1,1,3)} 
= (1,0,-1,0,1) —1(1,0,0,0,0) 2V3 
— 0 = (-3)(0,0, 1, 1,0) — 1(0,0,0,0, 1) 
= (0.0.4.0). 
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